Added validation for CFD CSCwq44858

[sudharson-soundrapandiyan]

Failure Scenario -> simulated with different file

fab3-apic1# python aci-preupgrade-validation-script_sudharson.py -c "6.0(2d)" -d "snapshot_files_check"
==== 2026-01-06T12-24-46+0000, Script Version v4.0.1 ====

!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!

To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :

Gathering Node Information...

Current version is overridden to 6.0(2d)

Gathering APIC Versions from Firmware Repository...

What is the Target Version? : 1

You have chosen version "6.0(9e)"

Collecting VPC Node IDs...101, 103

Progress: |---------------------------------------------------------------------------------------Progress: |---------------------------------------------------------------------------------------Progress: |---------------------------------------------------------------------------------------Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed

=== Check Result (failed only) ===

[Check 1/1] Snapshot files check... FAIL - UPGRADE FAILURE!!
apic_id apic_name snapshot_files

---

1 fab3-apic1 ce2_DailyAutoBackup-2025-12-24T14-30-12.tar.gz
1 fab3-apic1 ce2_DailyAutoBackup-2025-12-24T14-30-48.tar.gz
1 fab3-apic1 ce2_NDI_EXPORT_POLICY-2025-12-24T14-30-36.tar.gz
1 fab3-apic1 ce2_backup_policy-2025-12-24T14-30-06.tar.gz
1 fab3-apic1 ce2_config_export-2025-12-24T14-30-30.tar.gz
1 fab3-apic1 ce2_fabric_backup-2025-12-24T14-30-42.tar.gz
1 fab3-apic1 ce2_hourly_backup-2025-12-24T14-30-24.tar.gz
1 fab3-apic1 ce2_ndi_up-2025-12-24T14-30-18.tar.gz
1 fab3-apic1 ce2_ndi_up-2025-12-24T14-31-00.tar.gz
1 fab3-apic1 ce2_scheduler_backup-2025-12-24T14-30-54.tar.gz

Recommended Action: Contact Cisco TAC for Support before upgrade
Reference Document: https://datacenter.github.io/ACI-Pre-Upgrade-Validation-Script/validations/#Snapshot-files-check

=== Summary Result ===

PASS : 0
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 1
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 0
ERROR !! : 0
TOTAL : 1

Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED

Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.

  Result Bundle: /data/techsupport/preupgrade_validator_sudharson1_2026-01-06T12-24-46+0000.tgz

==== Script Version v4.0.1 FIN ====

Pass Scenario

fab3-apic1# python aci-preupgrade-validation-script_sudharson.py -c "6.0(2d)" -d "snapshot_files_check"
==== 2026-01-06T12-30-51+0000, Script Version v4.0.1 ====

!!!! Check https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script for Latest Release !!!!

To use a non-default Login Domain, enter apic#DOMAIN\USERNAME
Enter username for APIC login : admin
Enter password for corresponding User :

Gathering Node Information...

Current version is overridden to 6.0(2d)

Gathering APIC Versions from Firmware Repository...

What is the Target Version? : 1

You have chosen version "6.0(9e)"

Collecting VPC Node IDs...101, 103

Progress: |---------------------------------------------------------------------------------------Progress: |---------------------------------------------------------------------------------------Progress: |---------------------------------------------------------------------------------------Progress: |████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 checks completed

=== Check Result (failed only) ===

=== Summary Result ===

PASS : 1
FAIL - OUTAGE WARNING!! : 0
FAIL - UPGRADE FAILURE!! : 0
MANUAL CHECK REQUIRED : 0
POST UPGRADE CHECK REQUIRED : 0
N/A : 0
ERROR !! : 0
TOTAL : 1

Pre-Upgrade Check Complete.
Next Steps: Address all checks flagged as FAIL, ERROR or MANUAL CHECK REQUIRED

Result output and debug info saved to below bundle for later reference.
Attach this bundle to Cisco TAC SRs opened to address the flagged checks.

  Result Bundle: /data/techsupport/preupgrade_validator_sudharson1_2026-01-06T12-30-51+0000.tgz

==== Script Version v4.0.1 FIN ====
fab3-apic1#

Pytest cases

================================================================== test session starts ==================================================================
platform linux -- Python 3.8.10, pytest-7.4.0, pluggy-1.2.0
rootdir: /data/ssd/sudharson/pre_cfd_new/ACI-Pre-Upgrade-Validation-Script
configfile: pytest.ini
collected 38 items

test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs0-False-conn_cmds0-6.0(3d)-fabric_nodes0-PASS]
-------------------------------------------------------------------- live log setup ---------------------------------------------------------------------
[12:43:03.387 INFO init_system:6118(MainThread)] Cleaning up previous run files in preupgrade_validator_logs/
[12:43:03.388 INFO init_system:6120(MainThread)] Creating directories preupgrade_validator_logs/ and preupgrade_validator_logs/json_results/
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.389 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.390 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.390 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.391 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 2%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs1-False-conn_cmds1-5.2(1h)-fabric_nodes1-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.403 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.403 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.404 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.410 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 5%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs2-False-conn_cmds2-6.0(2a)-fabric_nodes2-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.416 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.417 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.417 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.419 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 7%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs3-False-conn_cmds3-6.0(2a)-fabric_nodes3-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.430 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.430 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.430 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.432 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 10%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs4-True-conn_cmds4-5.2(1h)-fabric_nodes4-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.447 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.447 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.448 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.449 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 13%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs5-False-conn_cmds5-6.0(2a)-fabric_nodes5-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.462 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.463 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.464 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.464 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 15%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs6-False-conn_cmds6-5.2(1h)-fabric_nodes6-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.477 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.478 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.478 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.479 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 18%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs7-False-conn_cmds7-3.2(6o)-fabric_nodes7-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.492 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.493 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.493 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.495 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 21%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs8-False-conn_cmds8-3.2(6o)-fabric_nodes8-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.508 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.508 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.509 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.511 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 23%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs9-True-conn_cmds9-3.2(6o)-fabric_nodes9-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.523 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.524 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.524 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.525 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 26%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs10-False-conn_cmds10-3.2(6o)-fabric_nodes10-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.538 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.539 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.540 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.541 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 28%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs11-False-conn_cmds11-3.2(6o)-fabric_nodes11-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.554 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.555 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.555 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.556 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 31%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs12-False-conn_cmds12-6.0(2a)-fabric_nodes12-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.569 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.570 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.570 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.572 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 34%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs13-False-conn_cmds13-6.0(2a)-fabric_nodes13-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.584 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.585 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.586 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.586 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 36%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs14-True-conn_cmds14-6.0(2a)-fabric_nodes14-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.600 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.600 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.601 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.602 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 39%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs15-False-conn_cmds15-6.0(2a)-fabric_nodes15-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.615 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.616 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.616 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.618 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 42%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs16-False-conn_cmds16-5.2(8g)-fabric_nodes16-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.630 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.631 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.632 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.633 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 44%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs17-False-conn_cmds17-5.2(8g)-fabric_nodes17-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.646 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.646 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.647 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.649 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 47%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs18-False-conn_cmds18-6.0(2a)-fabric_nodes18-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.661 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.662 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.663 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.664 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 50%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs19-False-conn_cmds19-5.2(8g)-fabric_nodes19-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.675 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.676 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.677 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.678 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 52%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs20-False-conn_cmds20-6.0(2a)-fabric_nodes20-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.691 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.691 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.692 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.693 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 55%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs21-False-conn_cmds21-6.0(2a)-fabric_nodes21-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.706 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.707 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.707 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.709 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 57%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs22-False-conn_cmds22-6.0(2a)-fabric_nodes22-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.721 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.722 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.723 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.724 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 60%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs23-False-conn_cmds23-5.2(8g)-fabric_nodes23-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.737 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.737 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.738 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.741 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 63%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs24-False-conn_cmds24-6.0(2a)-fabric_nodes24-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.752 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.753 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.753 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.755 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 65%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs25-False-conn_cmds25-3.2(6o)-fabric_nodes25-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.767 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.768 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.769 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.770 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 68%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs26-False-conn_cmds26-3.2(6o)-fabric_nodes26-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.783 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.783 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.784 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.785 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 71%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs27-True-conn_cmds27-3.2(6o)-fabric_nodes27-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.798 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.798 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.799 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.800 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 73%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs28-False-conn_cmds28-3.2(6o)-fabric_nodes28-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.813 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.814 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.814 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.815 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 76%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs29-False-conn_cmds29-3.2(6o)-fabric_nodes29-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.828 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.829 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.829 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.831 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 78%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs30-False-conn_cmds30-3.2(6o)-fabric_nodes30-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.843 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.844 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.845 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.847 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 81%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs31-False-conn_cmds31-3.2(6o)-fabric_nodes31-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.859 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.860 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.860 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.861 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 84%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs32-False-conn_cmds32-3.2(6o)-fabric_nodes32-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.874 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.875 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.875 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.877 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 86%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs33-False-conn_cmds33-3.2(6o)-fabric_nodes33-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.888 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.888 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.888 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.889 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 89%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs34-False-conn_cmds34-3.2(6o)-fabric_nodes34-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.901 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.901 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.901 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.904 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 92%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs35-False-conn_cmds35-3.2(6o)-fabric_nodes35-PASS]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.915 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.916 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.917 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check--------------------------| 0/1 checks completed
[12:43:03.918 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 94%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs36-False-conn_cmds36-3.2(6o)-fabric_nodes36-FAIL - UPGRADE FAILURE!!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.932 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.932 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.935 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.945 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [ 97%]
test_snapshot_files_check.py::test_snapshot_files_check[icurl_outputs37-False-conn_cmds37-3.2(6o)-fabric_nodes37-ERROR !!]
--------------------------------------------------------------------- live log call ---------------------------------------------------------------------
[12:43:03.960 INFO init_result:1182(MainThread)] Initialized in preupgrade_validator_logs/json_results/snapshot_files_check.json
[12:43:03.960 INFO _start_thread:1105(MainThread)] (snapshot_files_check) Starting thread.
[12:43:03.961 INFO wrapper:1349(snapshot_files_check)] Start snapshot_files_check
[12:43:03.963 INFO update_result:1191(snapshot_files_check)] Finalized result in preupgrade_validator_logs/json_results/snapshot_files_check.json
PASSED [100%]

================================================================== 38 passed in 0.61s ===================================================================