Databook
activeopen governmentAn award-winning transparency tool that combines over 50 official NYC open datasets — agencies, people, jobs, capital projects, schools, districts and procurement — into one searchable picture of how city government works.
Added robust error handling to the MCP client by implementing automatic retry logic and session refreshing. This update improves the reliability of the newsletter's data integration services during temporary network or authentication failures.
Launched the NYC district map featuring precomputed boundary overlaps.
Updated the API with new capital project endpoints, a post-ingest analytics hook, and a titles dashboard. Improved pipeline reliability and updated documentation.
Added a dataset profile page with six tabs, a tasks table, and an auto-populate endpoint. Implemented pipeline improvements, a health and freshness endpoint, and request retries with backoff.
Connected the normalizer to the Databook staging API, added a Tasks admin page with UIDs, and implemented Socrata ETag caching with a bulk sweep endpoint. Added the 39-type prjTypes core dataset, introduced a manual-edit tracking flag, and set up daily scheduled update checks with SES email notifications.
Updated the core entity and org tables with new filters, sortable columns, and a slide-out edit panel. Added full CRUD operations for file-based datasets, integrated Gemini 3 Flash for LLM matching with rate limiting, and replaced NTA and cityCouncilDistrict with Socrata sources. Fixed autocomplete, truncation, and fuzzy matching for NYC-prefixed organizations.