kert 8615be32cd feat(bib): dedupe pass in nightly zotero-sync — keep-earliest on title+date ...

CMS listservs re-send identical mail with a fresh Message-ID, so the
ingest correctly stores each send as a distinct Source and every sync
pushes both — 10 such twin pairs had accumulated in Cmsupdates
(removed by hand today). New bib.sync.dedupe_collection() groups a
Zotero collection by (title, date), keeps the earliest copy, and
deletes later ones from Zotero AND bib so the next sync can't
resurrect them. Wired as --dedupe-collection on sync-zotero and passed
by the nightly zotero-sync workflow. Runs under the same
zotero-stopped lock window as the push.

2026-07-10 16:22:07 -04:00

..

backends

feat(bib): dedupe pass in nightly zotero-sync — keep-earliest on title+date

2026-07-10 16:22:07 -04:00

add_carrier_to_zotero.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

add_cf_history_to_zotero.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

add_pprrvu_historical_to_zotero.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

add_zipcode_to_zotero.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

bootstrap_certs.py

fix(observability): finish Jaeger→Tempo migration across satellite files

2026-07-08 10:08:08 -04:00

bootstrap_secrets.py

remove: scrub all woodpecker references from codebase

2026-04-18 18:51:21 -04:00

bootstrap_sso.py

chore: drop deprecated Woodpecker references

2026-05-06 16:56:34 -04:00

build_product_susceptibility.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

build_skin_subs_analytics.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

build_skin_subs_anomaly.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

build_skin_subs_evidence_base.py

chore: prune dead code and refresh stale docs

2026-07-08 10:12:24 -04:00

build_skin_subs_geo_setting.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

check_freshness.py

feat(infra): version-pin freshness check + Renovate auto-bump for ARG pins

2026-07-08 19:55:44 -04:00

check_pdf_coverage.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

collect_grey_lit_skin_subs.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

coverage_badge.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

download_opps_files.py

feat(opps): recover CY2014-2020 Addendum B + fix ingest finder

2026-07-08 14:48:17 -04:00

dump_zot_schema.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

enrich_entity_tags_and_load_duckdb.py

chore: prune dead code and refresh stale docs

2026-07-08 10:12:24 -04:00

extract_study_characteristics.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

fetch_fr_attachments.py

feat: fetch Federal Register PDF + TXT for all bib rules

2026-03-27 00:02:35 -04:00

fetch_pdfs.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

file_concurrency_issues.py

fix(scripts): resolve Gitea label names to IDs in issue filer

2026-07-08 15:43:25 -04:00

fix_zotero_dates.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

fix_zotero_keys.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

gen_config.py

remove: scrub all woodpecker references from codebase

2026-04-18 18:51:21 -04:00

gen_readme.py

remove: scrub all woodpecker references from codebase

2026-04-18 18:51:21 -04:00

generate_alr_filenames.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_alr_reference_tables.py

reorg dev/ into scripts/ and seeds/, add PY2024 value sets

2026-03-03 22:05:49 -05:00

generate_alr_table_models.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_asr_table_models.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_cclf_docs.py

reorg dev/ into scripts/ and seeds/, add PY2024 value sets

2026-03-03 22:05:49 -05:00

generate_cclf_filenames.py

reorg dev/ into scripts/ and seeds/, add PY2024 value sets

2026-03-03 22:05:49 -05:00

generate_cclf_models.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_ccw_docs.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_ccw_models.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_cms_express.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_expressions.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_models.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_quality_measure_docs.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_reach_docs.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_reach_models.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_reach_participants.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

generate_skin_sub_claims.py

data: synthetic skin sub claims — 2,000 encounters, product + application codes

2026-03-25 10:09:20 -04:00

generate_ssp_county_models.py

reorg dev/ into scripts/ and seeds/, add PY2024 value sets

2026-03-03 22:05:49 -05:00

generate_zot_tables.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

ingest_asp.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

ingest_opps.py

feat(opps): recover CY2014-2020 Addendum B + fix ingest finder

2026-07-08 14:48:17 -04:00

install_certs.sh

feat: public SSO — fhirworx.io domain, Gitea OAuth2, Cloudflare tunnel

2026-04-09 19:06:33 -04:00

migrate_zotero.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

nb_fe_smoke.py

fix(ci): unbreak notebook quality gates first CI exercise

2026-07-10 11:36:25 -04:00

nb_integration.py

fix(notebooks): drop cascade errors from snapshot parsing

2026-07-10 11:38:30 -04:00

nb_issue_filer.py

feat(notebooks): quality gates — headless integration test, FE smoke gate, dedup issue auto-filer

2026-07-10 10:14:46 -04:00

nb_watcher.py

feat(notebooks): quality gates — headless integration test, FE smoke gate, dedup issue auto-filer

2026-07-10 10:14:46 -04:00

pkg_drift.py

feat: package supply chain — inventory, mirrors, drift, vuln scanning (refs #159–#168)

2026-03-24 17:02:30 -04:00

pkg_inventory.py

fix(ci): finish gitea→git container rename in pkg scripts; skip gitignored Dockerfiles in inventory

2026-07-09 21:27:02 -04:00

pkg_issues.py

fix(ci): finish gitea→git container rename in pkg scripts; skip gitignored Dockerfiles in inventory

2026-07-09 21:27:02 -04:00

pkg_mirror_sync.py

fix(ci): finish gitea→git container rename in pkg scripts; skip gitignored Dockerfiles in inventory

2026-07-09 21:27:02 -04:00

populate_quality_measure_value_sets.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

register_seeds.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

scrape_cms_data.py

reorg dev/ into scripts/ and seeds/, add PY2024 value sets

2026-03-03 22:05:49 -05:00

search_pubmed_skin_subs.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

seed_col_tags.py

implement P6 bibliography: col tags, bib sync, generate models, lineage (fix #22, fix #23, fix #24, fix #25)

2026-03-12 17:25:30 -04:00

setup_unity_catalog.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

snowball_citations.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

sync_secrets.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

test_network_isolation.sh

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

unity_catalog_example.py

chore: clean sweep — lint, format, stale refs, generated artifacts

2026-03-24 17:33:55 -04:00

zotero_archive_migrate.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00

zotero_fix_fields.py

feat: full session — mail servers, comment pipeline, PRISMA fetch, email ingest

2026-04-16 09:04:38 -04:00