Databook
activeopen governmentAn award-winning transparency tool that combines over 50 official NYC open datasets — agencies, people, jobs, capital projects, schools, districts and procurement — into one searchable picture of how city government works.
This update fixes a database corruption issue where concurrent threads crashed the pipeline with "No open result set" errors. The `get_db()` function was updated to yield an independent, thread-safe DuckDB cursor per call. A new concurrency test was also added to prevent future regressions.
Updated the production build process to be git-driven and managed directly within the repository.
Updated the error handling to log transient upstream outages as warnings instead of triggering Sentry errors. This prevents unnecessary alerts during temporary external downtime.
Downgraded transient upstream connection errors, timeouts, and 5xx responses from error to warning level. This prevents sustained NYC Open Data outages from triggering high-priority Sentry alerts while preserving full error logging for genuine pipeline bugs.
Fixed transient upstream Sentry 503 errors in the CSV download process by implementing a retry mechanism.
Updated the project documentation to correct the hosting information.