Meeting records watch

Agendas, packets and minutes for local public bodies in the Capital Region, Rochester and Mid-Hudson, checked against New York's Open Meetings Law publication rules.

Method

Entities. The list covers every town, village, city, county legislature, school district, BOCES and IDA in the three regional registries used by the meeting-video project, plus the state's school-district list. IDAs outside the Capital Region are still being added.

Venue discovery. We read each entity's website and agenda/minutes pages, along with existing civic-source registries, to find the document platform it uses: CivicPlus AgendaCenter, IQM2/Granicus, Legistar, BoardDocs, eScribe, Laserfiche, Municode Meetings, Diligent/iCompass, BoardBook, or a plain page that links PDFs. Fetchers cover CivicPlus AgendaCenter, IQM2, Legistar, plain agenda/minutes pages, and BoardDocs public portals (when enabled).

Fetching. A Cloudflare Worker cron lists each venue about every 6 hours and fetches agendas and minutes. For non-BoardDocs hosts, robots.txt is honored (including Crawl-delay), with at most one request per host every 2 seconds and a project user agent. BoardDocs public pages are collected when enabled, using a normal browser user agent, one in-flight request to the shared host, at least 3 seconds between requests, a per-site daily cap, and a circuit breaker. Attachment PDFs are downloaded; scanned PDFs become OCR jobs for team Macs. No meeting video is downloaded.

Text. When a PDF has a usable text layer, its text is extracted on the Worker. Scanned PDFs, under 200 characters per page, become OCR jobs that team Macs claim and OCR locally. Per-page text and confidence are stored.

Extraction and scoring. Minutes are parsed with conservative rules for motions, resolutions, tallies, roll calls, per-member votes, attendance, adjournment and executive-session motions. Each indicator follows the rubric. Evidence snippets are verbatim, at most 25 words, with a page number, and personal names are masked.

Limits.

Collection identity. User agent: Mozilla/5.0 (compatible; meeting-docs/1.0; +/meetings/oml/method).