Network Planner - Seems to be broken

[Targul]

I have been running into an issue where I am unable to run the propagation studies in the network planner. 

I have a historical study ran last on June 12th 3:23pm CST and have been unable to complete a study since then. The first one I attempted yesterday and told it to stop after it have been running for almost 24 hours and was not completeing (usually takes 10 - 15 mins)

I have seen two other people post similar issues today and am adding my information as a new topic tickect also while having responded to their posts too.

Any further attempts to run a study result in the following faild state error information:

Study type

Received power

Bands

All bands

Generated at

Jun 18, 2024, 10:59 AM

Elapsed

1:47

State

Failed

Error

Flume pipeline failed: generic::permission_denied: RPC (stagepkg) failed for cell 'jf': /BorgMaster.CreatePackage failed -- CLIENT_VIOLATES_BUILD_HORIZON: The binary that sent the RPC is too old. It was built at timestamp 1701786572 and at changelist 587942956. See go/borg-build-horizon-policy for details and fixes. RPC had build_context 'build_changelist: 587942956 build_timestamp: 1701786572 build_target_name: "//spectrum/planner/coverage/pipeline:main" ' and was sent by role spectrum-planner-coverage-pipeline. Binaries talking to Borgmaster must have been built stamped, not earlier than 2023-12-11 10:13:45 (1702318425), and after CL 0. Look in the INFO log for a dump of the failing protocol buffer. See go/borgcfg-logs if you need additional guidance how to find the logs. passed through: ==> dist_proc/dax/workflow/worker_pool_manager/cluster_manager/borg_cluster_manager_api.cc:563; source: coverage.cc:545

[Alex_S · Accepted solution]

Thanks for your patience.

Our engineering team believes they have identified and corrected the source of this issue - you should now be able to re-run coverage in the affected projects. 

[Targul]

Thanks. 

Verified it was working again yesterday with a propagation map that was sucessful.