Databook, Updates

2 Years of Databook Updates in one Post

Devin
Databook Civil Service Titles dashboard — stat tiles and popular-title cards

It's been over two years since we last posted a Databook update. In that time there have been many changes, expansions and upgrades.

Here's a summary of what's changed since our last post:

  • Mar 2024 — Brought charts to organization (agency) profiles.
  • May–Jun 2024 — Organization profiles gained a section menu, a headcount chart, and a jobs table.
  • Oct 2024 — Added an organizations directory and cross-linked orgs, charts, and profiles.
  • Jun–Jul 2025 — New project profiles and a large /capital/projects map with rich controls.
  • Dec 2025 — A civil-service Titles section: a Title Statistics dashboard, Popular Titles cards, salary ranges, weighted position metrics, and agency pie charts — plus a Styleguide page for the design system.
  • Jan 2026 — A Bootstrap 5 migration and People page redesign; Strapi-powered blog/articles; a Procurement section on agency profiles (Highlights, Contracts, Solicitations, Vendors); and an ingestion-log admin view.
  • Feb 2026 — Consolidated into a single Databook monorepo with a pytest suite, GitHub Actions CI, and auto-deploy to staging.
  • Feb 2026 — A DatabookNYC MCP server + chat widget so both people and AI assistants can query the data — with MCP tools spanning jobs, payroll, facilities, budget, schools, contracts, solicitations, and capital-project milestones, plus session logging.
  • Feb 2026 — A data pipeline (dataset registry, scheduler, extractors) with an admin data-health dashboard, and procurement endpoints (transactions, data sources, a hybrid dashboard).
  • Feb 2026 — A newsletter generator, and an async City Record Online (CROL) import handling 1M+ rows.
  • Mar–Jun 2026 — Experimented with a new Databook map platform that dives into building records linking over twenty records showing ownership, complaints, construction and so much more
  • Jun 2026 — The entity-matching normalizer was hardened for production — pytest + CI, Sentry error tracking, retries for transient outages, and a git-driven deploy.
  • Jul 2026 — A major NYCHA build-out: a dedicated landing page, searchable contract/payment/budget/revenue record explorers, and a vendor → PASSPort crosswalk (fuzzy + curated match tiers) federated into global search.
  • Jul 2026 — A Payroll domain reaching parity with CheckbookNYC, plus agency heads and addresses derived from the Greenbook.

What's next?

We're going to go in a few directions:

We'll continue monitoring and expanding the core Databook dataset as more data is released through the open data portal, just as we always have.

We're going to continue working on map.databook.nyc to create interfaces for NYC buildings and district data.

Now that we have all public Mayor's Office of Contract Services (MOCS) PassportPublic data and all of the Comptroller's Checkbook.NYC data, we're going to explore doing original analysis with a focus on surfacing interesting contracts and vendors.

Stay tuned for more, and more frequent, updates!