Releases: DataKitchen/dataops-testgen
Releases · DataKitchen/dataops-testgen
5.9.5
Bug Fixes
- sqlalchemy warning (7a10ee1)
- source data ORDER BY for Standardized_Value_Matches hygiene issue (f07c561)
Docker Image
datakitchen/dataops-testgen:v5.9.5
PyPI Package
5.9.4
Features
- ui: add flagged status to test definitions (TG-976 Phase 1) (07a5a0f)
- ui: add notes dialog, review column, and sorting improvements (TG-980) (84b0ad1)
- mcp: add MCP server foundation with JWT auth and ping tool (c123552)
- mcp: add P0 tools, resources, prompts and model extensions (8f69936)
- projects: add a project membership to handle user role in a project (6533624)
- plugins: support multiple pages per plugin spec (6c232ef)
- auth: scope sidebar projects to user memberships (e654258)
- ui: add Dialog component; fix Portal stacking context (b0c96a3)
- ui: add disabled prop to Toggle; add notIn form validator (356ba70)
- mcp: polish inspector output and add validation (2761ffa)
- catalog: add CSV import/export for metadata (62e490b)
- mcp: enforce project-level permission scoping on all tools (f4e876a)
- support oauth for databricks (cffe34c)
- add support for Oracle 12c+ (085e45d)
- add support for SAP HANA (4b993b5)
- add safe_rerun to prevent data loss on Streamlit rerun (a0be715)
- mcp: sanitize errors at tool/resource/prompt boundary (8e5e7b2)
- pii masking, xde, hash fingerprints (8bdaa83)
- test suites: add search filter (ffb41a9)
- wizards: make steppers clickable (14f5e8c)
Bug Fixes
- resolve ruff linting issues (import sorting, dict literals, unused import) (b57e70f)
- improve upgrade commands to update revision after each script (0db6fdb)
- ui: misc JS fixes (08a6a8a)
- ui: mirror utils.js JSDoc type improvement to static copy (9b4e120)
- ui: visual inconsistencies and navigation bug (e2e95df)
- ui: hide portal when main content scrolls (3100ae7)
- navigation: add project/permission checks and redirects (f1d29e1)
- ui: address MR review feedback for CSV metadata import (TG-988) (cb1c9dc)
- ui: skip entire row on CDE error, not just the field (TG-988) (e694400)
- ui: fix auth base class kwarg, review column spacing, and grants (e3b0581)
- ui: address MR review feedback for notes dialog (TG-976) (1f2a5f8)
- discrepancies between flavors in hygiene issues and test types (e13a7f5)
- sql server: make Dupe Rows test case sensitive (0e6be25)
- discrepancies in Weekly Record Count test (911f81a)
- edit-monitors: bugs in form - validate required fields (24e6299)
- data catalog: remove test suite links for catalog role (351d54d)
- update doc links (8e68494)
- monitors: generate freshness monitors when profiling data already exists (8b39bbb)
- use database_session() context manager for schedule query (de20ee0)
- always clear cache in safe_rerun (671e702)
- TG-1005: correct Daily_Record_Ct operator and Email_Format lookup regexes (adc7883)
- TG-1005: make MSSQL calendar gap lookups consistent with other flavors (5b2d69d)
- TG-1005: fix cross-flavor test type bugs found by validation suite (b1100e0)
- ui: render portals/tooltips on top of Streamlit dialogs (3b18a69)
- ui: add support for caption in select options (9e7ce46)
- monitor: use excluded days from schedule if active (31c0361)
- remove summary from edit table group dialog (36aa858)
- data catalog: add help text (a326e67)
- updates to pii masking and xdes (0146128)
- scheduler shutdown race — check _stopping before blocking on _reload_event (4cdb3f2)
- database urls detected as emails (592ce63)
- data catalog: improve flag styling (39c82cf)
- monitor generation fails to find test suite (8d3667b)
- edge case in column history dialog (6c82a06)
- schedules dialog: bug in pausing/deleting (7f105d5)
- run tests: hide button in dialog after clicking link (2ead7ac)
- table group: remove stepper from edit dialog (62e1b4c)
- truncate timestamps to date in Daily_Record_Ct measure formula (1019526)
- cast timestamps to date in Daily_Record_Ct source data lookup (Databricks) (25636ca)
- ui: portals were closing when a nested portal opened (f5747aa)
- emails: move app links to left (2512c9e)
- update error text to be consistent (8d461c3)
- test definitions: handle empty suite (04dbd1b)
- scorecard: error on adding notification (b94c506)
- copy/move tests: unique key constraints (1dfbfd9)
- data catalog: prefix icons disappear after saving (104e0b8)
- missing imports (66f244e)
Refactors
- remove pydantic and streamlit-pydantic dependencies (002d5da)
- hide MCP behind feature flag and standardize boolean settings (87f7205)
- decouple RBAC from enterprise plugin via PluginHook (67749e4)
- mcp: rewrite server instructions and handle plugin load errors (c73dfcc)
- mcp: hide internal test_type codes from user-facing output (cacab09)
- mcp: replace global admin bypass with role-based permissions (99e8781)
- profiling: replace yaml files with TG- conditional SQL templates (f50b454)
- flavor: make FlavorService stateless with explicit params (094a15b)
- introduce database_session context manager (f82e34c)
- replace st.rerun with safe_rerun in UI code (e43a3ab)
- track writes via after_flush, clear cache in safe_rerun (292f1ab)
- remove cache-clearing side effects from model mutations (ff7917f)
- remove redundant cache clears from view callsites (df62103)
- remove explicit commits from model mutations (5732304)
Miscellaneous
Docker Image
datakitchen/dataops-testgen:v5.9.4
PyPI Package
5.0.2
Bug Fixes
- handle duplicates before applying unique index (509541e)
Docker Image
datakitchen/dataops-testgen:v5.0.2
PyPI Package
5.0.1
Features
- add standard generation set (46d0c11)
- monitors: add volume trend and metric trend tests (4c92f14)
- monitors: add test threshold prediction (20d0c77)
- monitor: use the new table component for the monitor list (ecbd0ea)
- add table monitor dialog and enable monitor suite (9b4f797)
- monitors: display volume trend chart (27c5c6c)
- monitors: display schema anomalies by table (caa52cd)
- monitors: add settings and delete dialogs (3da24e6)
- monitors: use SARIMAX to support excluding weekends and holidays (c2584e8)
- table groups: add standard and monitor suite wizard steps (5cad913)
- connections: add standard and monitor suite steps to wizard (ab25af6)
- monitors: display prediction in volume trend chart (4b78b96)
- monitors: enable notification settings for monitors (edf41c1)
- freshness: add new test - regenerate monitors when needed (a1df201)
- notifications: warn users of duplicate notification deliveries (ae09a53)
- monitors: indicate training mode - display tables when no results (12c38d9)
- monitors: configuration for regenerating freshness (badb908)
- quick-start: Adding Monitoring features (8cc2b04)
- quick-start: Improving monitor data as QA feedback (5570cee)
- monitors: add Table Monitors dialog + misc fixes (cea61bb)
- charts: Replacing the bitnami charts and images (753a7cc)
- monitors: add metric monitors (50319d4)
- monitors: display predicted table freshness events (e1a3455)
- monitors: display threshold lines for volume and metric charts (3774dba)
- ui: add starting at/on offset to cron schedule editor (b975f6f)
- monitors: allow filtering by anomaly types (75533ee)
- monitors: add toggle to show more history in dialog (60ff579)
- monitors: add deep-link to table trends dialog (8c707a0)
- monitors: freshness monitor with gap-based thresholds and schedule inference (7b98b84)
Bug Fixes
- generation set: add dupe rows to standard (a2a47d0)
- monitors: miscellaneous fixes and enhancements (70ab739)
- css: make toolbar styles consistent (aea7e71)
- monitors: remove monitor schedules from test run schedules dialog (c3d3ced)
- monitors: bugs in cli, models and prediction (a10a6b3)
- monitors: update holiday codes and timezones (cfd3b92)
- charts: offset schema chart lines when too short (26e3081)
- security: Fix Docker Scout vulnerabilities (e87b017)
- quick-start: persist the SMTP settings (a210134)
- monitors: filter out undefined items in timestamps list (d043cb5)
- parse dates from int or str properly (c29a3f1)
- profiling: add missing column to CTE (c1b3cdb)
- monitors: sort the points to draw the volume chart path (ac1d0e2)
- monitors: freshness results used for prediction (136db77)
- monitors: misc display updates (9e5cd3d)
- quick-start: update monitor iterations (d3f3936)
- rendering errors in a couple pages (91f04aa)
- Fix Observability export (3283d83)
- monitors: improve tooltips in charts - fix state bug in threshold form (74f0412)
- monitors: improve loading and form (b5c75e3)
- monitors: fix charts height calculation (d9a22a0)
- monitors: configuration and quick start improvements (fce03aa)
- ui: improve loading performance (111fdca)
- monitors: update form states after saving (7318a53)
- ui: lazy load plugin components (a5f6203)
- test-types: update text strings to match docs (ec9c26d)
- monitors: misc style and quick start updates (904767c)
- monitors: conditionally display ticks decimals (74a3655)
- monitors: table trend chart x axis ticks overlap (751236b)
- freshness: numeric overflow errors (883016f)
- test result: history graph broken when NaN values present (50955af)
- emails: bugs in test run and monitor run templates (50666bb)
- add email source to mixpanel events (507c4bb)
- monitors: handle errored monitors (d2ac510)
- tests: fix 28 broken unit tests and restructure test suite (48ad053)
- monitors: handle dropped and re-added tables (80d40e4)
- ui: misc changes to hygiene issues and test results (b2f0381)
- monitors: widen prediction thresholds (09f3319)
- docs: update help links on all pages (74f6a21)
- monitors: reset pagination on filtering (9bc11bc)
- monitors: error on empty state (43e8156)
- data-catalog: display new table/column names in bold (74b4da1)
- monitors: tooltip position in dialog (3add174)
- tests: NULL condition for tolerances applies to 0 values (a501c4f)
- monitors: match anomaly summary in email with UI (92e065d)
- quick-start: update data for freshness anomaly (225d268)
- monitors: constrain volume lower bound for cumulative tables (064ad0c)
- monitors: constrain prediction for volume monitor to be non-negative (5118316)
- monitors: prevent overconfident prediction bounds (67a1afb)
- upgrade script missing schema (075e557)
Refactors
- schedules: reuse logic to sample cron expressions (6ee5df8)
- monitors: add job key for monitor suites (b9765e1)
- wizards: update summary step (1e87866)
- autogeneration: generate volume and schema tests without profiling (087befe)
- table groups: display progress in creation wizard (b9dc4f2)
- notifications: reset form only on edit (de34c5e)
- notifications: sort alphabetically based on the scope (ace6f79)
- monitors: open table monitor charts from anomaly tags (05897cb)
- monitors: display markers on volume chart (91af3f4)
- monitors: expand schema chart markers clickable area (69970a9)
- monitors: visual changes to the table trend charts (8e818ca)
- monitors: use multi-barchart for schema changes (5441dd6)
- monitors: allow hiding changes columns (35c540a)
- monitors: allow sorting by anomalies count (f78c126)
- monitors: dynamic tick width for trends chart (7a04e44)
- monitors: add legend to table trends charts (8ab8065)
Miscellaneous
- move sql templates to yaml files (b2ecbc9)
- work around Streamlit loading of v2 components (26cc8e2)
- monitors: limit shown prediction points to <= lookback (d0c12d0)
- check changes in styling after st upgrade (f2f81cf)
Docker Image
datakitchen/dataops-testgen:v5.0.1
PyPI Package
testgen-services-1.0.1
A Helm chart for Kubernetes
testgen-services-1.0.0
A Helm chart for Kubernetes
testgen-1.1.0
A Helm chart for Kubernetes
4.39.2
Features
- notifications: Adding Test Run notifications (52382e8)
- notifications: Adding Score drop notifications (e1dc227)
- notifications: Miscellaneous fixes (7be4abc)
- notifications: Adding Profiling Run notifications (57d697e)
- notifications: Miscellaneous fixes and unit tests (c543bc1)
Bug Fixes
- emails: update score drop template styles (43e71c9)
- emails: update test run template to avoid flex styles (3de9098)
- emails: update profiling run template (9a612fb)
- emails: normalize test definition id in results diff (c2c2577)
- table freshness: bugs in calculating historical thresholds (61bbf7c)
- misc ui improvements (a98d0b5)
- emails: add empty state message when smtp server not configured (91ff18b)
Miscellaneous
- Code review feedback (98ec5ba)
Docker Image
datakitchen/dataops-testgen:v4.39.2
PyPI Package
4.38.7
Bug Fixes
- test definitions: add dialog error (fdb3ce9)
Docker Image
datakitchen/dataops-testgen:v4.38.7
PyPI Package
4.38.6
Bug Fixes
- pass signal (275e16a)
- typing for filter options (62de7ba)
- score-breakdown: prevent infinite looping and make defaulting logic consistent (81a63af)
- temporarily disable Schema Drift test (a8d6549)
Docker Image
datakitchen/dataops-testgen:v4.38.6