NCNYC Civil Title Viewer
Profiles of NYC civil-service titles — descriptions, positions, roles and pay. Began as a standalone experiment and now lives as Databook’s titles section.
DA
activeopen government
Databook
An award-winning transparency tool that combines over 50 official NYC open datasets — agencies, people, jobs, capital projects, schools, districts and procurement — into one searchable picture of how city government works.
DASubprojects
In the open
Activity
Jul 15Updated the CheckbookNYC extractor to validate that HTTP 200 responses contain valid XML before parsing. If a non-XML error page is returned due to throttling, the extractor now retries the request with exponential backoff instead of silently breaking the pagination loop and truncating the fiscal year data.wegovnyc/databook-private ↗Jul 14Added NYCHA contracts, budget, and revenue domains to the data, API, and frontend layers. Implemented retry and backoff logic for CheckbookNYC throttling, and optimized the budget refresh process to update only recent fiscal years. Adjusted budget defaults to the latest fully-closed fiscal year.wegovnyc/databook-private ↗Jul 13Added a Capital Projects mini-dashboard and spending chart to the procurement section, ensuring field consistency with capital projects. Improved spending data ingestion speed by 7x, automated weekly lake refreshes, optimized cache pre-warming, and increased memory limits to prevent API out-of-memory errors.wegovnyc/databook-private ↗Jul 12Fixed API and database memory leaks by capping DuckDB memory, serializing startup cache pre-warming, and limiting subdataset rows. Resolved OOM crashes by scoping the contract spend-map and bounding the digital-reform cache.wegovnyc/databook-private ↗Jul 11This pull request adds a planning document outlining the scope and roadmap for expanding the Contracts domain to match CheckbookNYC capabilities. The plan details how to deliver new features like contract utilization rates, payment timelines, and sub-vendor breakdowns using existing data pipelines, alongside a phased timeline for future API and frontend updates.wegovnyc/databook-private ↗Jul 11Added budget, revenue, and M/WBE spending domains with corresponding API endpoints and frontend lenses. Integrated Checkbook spending data, sub-vendor dashboards, and enhanced contract profiles with CSV export. Redesigned and consolidated the agency profile pages, collapsing procurement subsections and adding a hero component.wegovnyc/databook-private ↗Knowledge
No knowledge items yet.
Repositories
wegovnyc/databook_interfaceJan 26, 2022