Development Documentation
View as:

Auto-generated from: scripts/ — Last scanned: 2026-06-08T13:11:14.906459+00:00

Script Reference

108 utility scripts in scripts/:

ScriptDescription
__init__.pyPackage marker — required so PyInstaller treats scripts/ as a package
_lib_steps.pyEmit structured step events for the fabric-ui JobRunner.
add_bronze_shortcut.pyCreate a OneLake shortcut in a feature environment's FEAT-X-Bronze/LH_Bronze.
apply_dictionary_learnings.pyapply_dictionary_learnings.py
apply_report_renames.pyApply column renames across all .json files in workspaces/reports/.
archive_ax_data.pyArchive AX 2012 data from Lakehouse_Bronze_AX to Azure Blob Storage.
audit_dev_uat_parity.pyDEV vs UAT workspace-item parity audit.
audit_silent_failures.pyAudit pipeline YAML for silent-failure patterns without justification.
bootstrap_bronze_data.pyBootstrap Bronze data for first-time environment provisioning.
bronze_git_sync.pySync a Fabric Bronze workspace from git (updateFromGit).
build_90d_flow_page.pyRebuild the '90+d Flow' page in Stock Report.Report/report.json.
build_gold_local.pyBuild Gold models into local DuckDB. Zero Fabric CU.
check_cascade.pyCascade detection: trace column/measure renames across all project layers.
check_column_alignment.pyCheck dbt mart output columns against TMDL semantic model expectations.
check_cu_utilization.pyCheck Fabric capacity CU utilization before starting a production dbt build.
check_feature_env_activity.pyCheck feature environment activity and auto-teardown inactive environments.
check_main_bindings.pycheck_main_bindings.py — PR gate for merges into main / release/*.
check_no_stdin_reads.pyFail if any file under scripts/ has a read -p or input( in a non-allowlisted place.
check_pipeline_parity.pyVerify the three dbt build pipelines have the same step set.
check_spn_access.pyCheck what Fabric API access the SPN actually has.
cleanup_dbt_backups.pycleanup_dbt_backups.py
cleanup_dev_workspaces.pyDelete all SemanticModel and Report items from DEV Semantic/Reports workspaces.
cleanup_uat_workspace_folders.pyDelete leftover folders and zombie items from UAT-Semantic and UAT-Reports.
compare_parallel_runs.pycompare_parallel_runs.py
configure_semantic_model_access.pyConfigure semantic model access and RLS role assignments.
deploy_dataverse_shortcuts.pyCreate/sync Dataverse shortcuts in Lakehouse_Bronze.
deploy_shortcuts.pyDeploy all shortcuts in Lakehouse_Bronze from shortcuts.metadata.json.
deploy_to_feature.pyDeploy Fabric items to a feature environment.
discover_gold_consumers.pyDiscover all active consumers of the current Lakehouse Gold / Gold Warehouse.
download_bronze_to_local.pyDownload Bronze (Lakehouse) Delta tables from any provisioned environment as
ensure_application_data_lists_mirror.pyEnsure Application_Data_Lists MirroredDatabase exists in the Bronze workspace.
ensure_gold_lakehouse_bronze.pyEnsure Lakehouse_Bronze exists in Gold workspace with shortcuts pointing to Bronze workspace.
execute_security_sql.pyExecute SQL security scripts against a Fabric Warehouse using access token auth.
export_dev_data.pyexport_dev_data.py
fabric_connections.pyShared Cloud Connection (SCC) management for Fabric semantic models.
fabric_git_sync.pyTrigger Fabric workspace git sync (updateFromGit) for all workspaces in an environment.
fabric_sync.pyfabric_sync.py — safe UI↔git sync for feature-workspace developers.
find_broken_report_refs.pyFind report column references that don't match any semantic model column.
fix_90d_flow_gaps.pyFix all spec §7 gaps in the '90+d Flow' page of Stock Report.
generate-dev-stubs.pygenerate-dev-stubs.py
generate_bronze_methods_config.pyGenerate functions/shared/config/bronze_methods.yaml from shortcut manifests.
generate_changelog.pyGenerate a deployment changelog by diffing two dbt manifest.json files.
generate_data_dictionary.pygenerate_data_dictionary.py
generate_monitoring_report.pyGenerate the ETL Monitoring Power BI report (report.json) programmatically.
generate_parameter_file.pyGenerate fabric-cicd parameter.yml files for environment-specific deployments.
generate_transport_b2b_report.pyGenerate report.json for Transport B2B Analysis report.
inject_env_banner.pyInject environment banner into Power BI report pages.
inventory_sql_views.pyInventory existing SQL views on Gold Warehouse and Bronze Lakehouse SQL endpoints.
lint_pipeline_yaml.pyLint Azure DevOps pipeline YAML files.
manage_dbt_target.pyAdd or remove feature dbt targets from profiles.yml (Story 5d.3).
migrate_ax_shortcuts.pyMigrate AX shortcuts to cross-workspace OneLake shortcuts.
migrate_bronze_schemas.pyMigrate Lakehouse_Bronze shortcuts.metadata.json to schema-enabled layout.
monitor_chronic_failures.pyList pipelines whose last N runs were all failed; optionally disable schedules.
persist_dbt_artifacts.pyPersist dbt run artifacts to OneLake Bronze Lakehouse as Delta tables.
populate_semantic_model_ids.pyPopulate UAT semantic model ID mappings in deployment/uat.yml.
profile_loader.pyProfile loader — loads, validates, and composes dev-profiles/*.yml.
promote_cherry_pick.pyCherry-pick a merged PR onto a target release branch and open an ADO pull request.
provision_feature_env.pyFeature environment provisioning orchestrator (Story 5d.1, updated 5f.6 + Epic 10 full-stack).
provision_sandbox.pySelf-service sandbox provisioning.
publish_workspace_app.pyValidate workspace app configuration and verify reports exist in workspace.
refresh_bronze_tables.pyRefresh Bronze Lakehouse SQL endpoint metadata before dbt build.
refresh_feat_gold.pyRefresh a feature Gold Warehouse.
refresh_semantic_models.pyRefresh all semantic models in a Fabric workspace.
rename_parquet_to_sql.pyRename columns in dev-data//*.parquet from Delta-logical (snake_case)
sanitize_workspaces_for_main.pysanitize_workspaces_for_main.py
screenshot_feature_report.pyExport feature-workspace reports via Power BI REST and save locally.
seed_feature_bronze.pySeed a feature branch Bronze Lakehouse with sample data from dev-data/.
sync_broker_tables.pySync broker tables by reading CSVs from Bronze Files/ shortcuts and writing Delta to Bronze Tables/.
sync_ci_shortcuts.pysync_ci_shortcuts.py
sync_cloud_parquets.pysync_cloud_parquets.py
sync_descriptions_to_tmdl.pysync_descriptions_to_tmdl.py
test_export_query.pyTest an export query locally against Gold_Warehouse.
test_spn_permissions.pyTest sp-fabric-platform-admin SPN permissions for Epic 4.
test_sql_endpoint_access.pyTest connectivity to Gold Warehouse and Bronze Lakehouse SQL endpoints.
update_tmdl_column_refs.pyUpdate TMDL column references from old naming to snake_case per ADR-13.
upload_reports_direct.pyUpload reports to a Reports workspace via Fabric REST API directly.
upload_to_bronze.pyUpload a local file to a feature environment's FEAT-X-Bronze/LH_Bronze/Files/ folder.
validate_bronze_immutability.pyValidate Bronze immutability controls.
validate_clean_provisioning.pyValidate clean provisioning of the 4-workspace architecture.
validate_connections.pyValidate that the platform-admin SPN has access to all connections referenced in workspaces/.
validate_credential_hygiene.pyCredential hygiene validator for fabric_monorepo (Story 6.6, NFR-S3).
validate_cutover.pyPost-cutover validation script for the new production workspace.
validate_deployment_config.pyValidate deployment config files for missing or empty values.
validate_descriptions.pyvalidate_descriptions.py
validate_new_datalake.pyvalidate_new_datalake.py — One-off validation of Gold_Warehouse vs Lakehouse_Gold.
validate_powerbi.pyPre-flight validator for Power BI semantic models + reports.
validate_schema_dependencies.pyvalidate_schema_dependencies.py
validate_semantic_deployment.pyValidate semantic model deployment: detect orphaned column references.
verify_semantic_credentials.pyPost-bind credential verification for Fabric semantic models.
wait_for_sources.pyWait until all dbt source tables exist in the Fabric SQL endpoint.
watch_main_pipelines.pyPoll ADO REST for pipeline state on a target SHA; emit one line per status change.
_lib_spn.sh=============================================================================
_lib_tools.sh=============================================================================
_lib_venv.sh=============================================================================
create-dev-env.sh=============================================================================
create_deployment_tag.shCreate a deployment tag and output git log since previous deployment.
deploy-to-dev.sh=============================================================================
dev-build.sh=============================================================================
export-dev-data.sh=============================================================================
generate_and_serve_docs.sh=============================================================================
pr_prepare.sh=============================================================================
provision_feature_env.sh=============================================================================
rollback_prod.shscripts/rollback_prod.sh
setup-local.sh=============================================================================
teardown-dev-env.sh=============================================================================
teardown_feature_env.sh=============================================================================
test_all_profiles.sh=============================================================================
tf_autoimport_fabric_roles.sh=============================================================================