Releases: Giskard-AI/giskard
Releases · Giskard-AI/giskard
v2.0.0b34
What's Changed
- [GSK-2060] extra debug check missing by @rabah-khalek in #1556
- Try to import lightbgm first by @Hartorn in #1555
- Add cost estimate to LLM scan by @mattbit in #1532
- Docs revamp for launch by @luca-martial in #1554
Full Changelog: v2.0.0b33...v2.0.0b34
v2.0.0
What's Changed
- fixing disparate impact related issues by @rabah-khalek in #878
- [GSK-829] Increase debounce timeout in Inspector by @henchaves in #926
- Add LicenseID in Mixpanel by @Googleton in #959
- Giskard v.2 by @andreybavt in #865
- Mark documentation dir in gitattributes by @mattbit in #1154
- cleanup by @andreybavt in #1156
- [GSK-1201] Enable testing search bar by @henchaves in #1158
- Some fixes for quickstart notebook by @Googleton in #1167
- [GSK-1267] Fix slicing function name overflow by @henchaves in #1161
- [GSK-1196] Update table of debugging sessions by @henchaves in #1157
- Refactoring/update notebooks by @AbSsEnT in #1168
- [GSK-1236] Add spinner to explanations while its computing by @henchaves in #1165
- [GSK-1277] Fix redirect errors on Debugger component by @henchaves in #1160
- Perso/andrey/black by @andreybavt in #1166
- Only set the backend as not ready when there is an API error by @kevinmessiaen in #1174
- Fixed display issue on smaller screen height by @kevinmessiaen in #1171
- [GSK-1297] Add ways to copy project key by @henchaves in #1177
- [GSK-1304] Add tests for over- and under-confidence by @mattbit in #1173
- [GSK-1296 Change the starting page of a project by @henchaves in https://github.com//pull/1176
- GSK-1303 - Feature/gsk 1271 test UI status message gets squeezed spacing uneven by @kevinmessiaen in #1170
- [GSK-1320] Make AddTestToSuite scrollable by @henchaves in #1183
- Await for backend to be ready before showing link by @kevinmessiaen in #1172
- [GSK-1235] Fix segmentation fault problems when running pytest by @mattbit in #1164
- Add info about lightgbm issue on MacOS in dev environment docs by @mattbit in #1186
- Feature/gsk 1233 when a test is buggy the whole test suite does not return by @kevinmessiaen in #1155
- Fixed postgres 13 installation by @kevinmessiaen in #1187
- [GSK-1078] Correlation detector by @mattbit in #1178
- [GSK-1275] Importance of metrics calculated on partial data slice by @mattbit in #1169
- [GSK-1274] Refactoring of demo by @rabah-khalek in #1181
- [GSK-1275] Importance of metrics calculated on partial data slice by @mattbit in #1193
- Bump mlflow from 2.3 to 2.3.1 in /backend/src/main/resources/demo_projects/credit/models/dc70b21c-55f7-4873-9b58-0b28820dfaea by @dependabot in #1191
- [GSK-1341] Fix bug in base text perturbation detector by @mattbit in #1192
- [GSK-1199] Implement websocket to get worker status by @henchaves in #1179
- Fixed scroll issue in catalog by attaching vuetify select by @kevinmessiaen in #1195
- Fixed left navigation drawer disappearing on small screens by @kevinmessiaen in #1203
- [GSK-1295] Redirect to Testing after adding a test to current suite by @henchaves in #1184
- [GSK-1346, GSK-1347, GSK-1189] Update scan widget by @mattbit in #1207
- gsk-1348/updating docs by @rabah-khalek in #1200
- Make scan widget optionally embeddable by @mattbit in #1209
- [GSK-1315] Update tabs with code snippet by @henchaves in #1206
- task/fixed scan result embed option by @rabah-khalek in #1211
- Global argument of a test suite take priority on test argument by @kevinmessiaen in #1213
- [GSK-1384] Fix internal worker exception due to artifact logging by @Inokinoki in #1212
- rectified a spelling mistake in CONTRIBUTING.md file by @sachelsout in #1228
- [GSK-1373] Configure nightly Giskard build that runs all tests by @Inokinoki in #1210
- GSK-881 & GSK-967 & GSK-730 - Get rid of eli5 + improve explanation by @kevinmessiaen in #1188
- [GSK-1399] Make CodeSnippet props optional by @henchaves in #1237
- [GSK-1376] Add search bar for all tabs with lists by @henchaves in #1233
- Fixed metamorphic tests for LLM by @kevinmessiaen in #1185
- Split train and test set in fraud detection fixtures by @mattbit in #1235
- [GSK-1300] Reorganize breadcrumbs by @henchaves in #1182
- [GSK-541] Migrate Vue components to Composition API by @henchaves in #1232
- [GSK-1289] UI issue incorrect colour of correctly predicted labels by @henchaves in #1231
- [GSK-1180, GSK-1410] Add validation and user-friendly error messages to scan by @mattbit in #1240
- [GSK-1416] Update Datasets and Models logo by @henchaves in #1239
- GSK-1335 & GSK-1264 & GSK-1255 - Test re-execution result not clear by @kevinmessiaen in #1196
- [GSK-1365] Make websocket reactive to worker status changes by @henchaves in #1236
- Fix regex in scan text transformations (fixes GSK-1422) by @mattbit in #1245
- Removed pickle tag since everything is a pickle by default by @kevinmessiaen in #1246
- Fixed issue with form not being reset when switching users by @kevinmessiaen in #1247
- [GSK-1408] Fix console errors on frontend by @henchaves in #1242
- Feature/gsk 1349 make it possible to upload artifacts to a huggingface spaces by @andreybavt in #1230
- feature/debug by @rabah-khalek in #968
- [GSK-1400] Add spinner to the run button in the catalog by @henchaves in #1252
- Feature/gsk 1157 better display of test suite result in jupyter notebook by @kevinmessiaen in #1197
- [GSK-1343] Better support for CUDA and models + docs improvements by @mattbit in #1234
- Fixed issue where prediction is not being updated on input value change by @kevinmessiaen in #1254
- [GSK-1283] Additional LLM issue detectors by @mathieuroques in #1190
- Fixed creation of slicing function by @kevinmessiaen in #1258
- [GSK-1321] Integration with MLflow by @rabah-khalek in #1189
- Detach TransformationFunction selector from menu by @kevinmessiaen in #1244
- Make it possible to completely delete users not just disable by @kevinmessiaen in #1243
- Fixed display in compare executions by @kevinmessiaen in #1259
- [GSK-1477] Ensuring backward compatibility of models by @rabah-khalek in #1261
- Small doc polish: Why Giskard + emojis in the README by @alexcombessie in #1260
- Fixed issue with variable scope overriding suite result by @kevinmessiaen in #1264
- Update enron_email_classification_sklearn.ipynb by @mathieuroques in #1265
- Refactored example amazon notebook by improving model to work better … by @AbSsEnT in #1270
- Fixed issue with model and dataset selector not resetting by @kevinmessiaen in #1267
- Added wage classification notebook to the docs. by @AbSsEnT in #1274
- [GSK-1402] Make websocket default state as undefined by @henchaves in #1251
- [GSK-1473] Enabling rewrite_prompt for giskard evaluator by @rabah-khalek in #1266
- [GSK-1438] Invited users can't upload artifacts to a project by @henchaves in #1256
- [GSK-1437] Fix Dataset unexpectedly delete by @henchaves in https://github.com/Giskard-AI/gisk...
v2.0.0b33
What's Changed
- Do not truncate examples text in scan report by @mattbit in #1548
- [GSK-2055] Add unused field for coherence by @Hartorn in #1550
- Fix typo & copy paste in build file by @Hartorn in #1547
- V2 launch docs revamp by @luca-martial in #1518
- [GSK-2057] Disable finite number enforcing by @Hartorn in #1551
- Fix back mock by @Hartorn in #1553
- [GSK-1911] Add cache worker pool by @Hartorn in #1521
- GSK-2060: take into account
debug
argument when running LLM tests by @andreybavt in #1552
Full Changelog: v2.0.0b32...v2.0.0b33
v2.0.0b32
Full Changelog: v2.0.0b31...v2.0.0b32
v2.0.0b31
What's Changed
- Feature/gsk 1923 unable to run a test when default values arent uploaded by @kevinmessiaen in #1488
- [GSK-2037] Fix test for Benjamini-Hochberg filtering in PerformanceBiasDetector by @mattbit in #1542
- [GSK-2030] Various mlflow related updates by @rabah-khalek in #1530
- [GSK-1509][GSK-1990] Add up/download tests for model, dataset and callable by @Inokinoki in #1535
- [GSK-2045] issue with fixed test inputs by @rabah-khalek in #1544
- [GSK-1906] Allow output to be anonymous from ad-hoc test by @Inokinoki in #1541
- [GSK-2036] Fix debug by @Hartorn in #1546
- Rename server to hub by @Hartorn in #1509
Full Changelog: v2.0.0b30...v2.0.0b31
v2.0.0b30
What's Changed
- [GSK-1888] Avoid to send nullable values in callable from ML worker to Backend by @Inokinoki in #1503
- Remove auto-created
version
from mandatory fields by @Inokinoki in #1528 - [GSK-2015,GSK-2012,GSK-1998] LLM tests refactoring by @mattbit in #1522
- [GSK-2008] Add
metric_name
in test results by @mattbit in #1523 - [GSK-1966] Restored prompts from garak without line wrapping by @rabah-khalek in #1526
- [GSK-2020] Updated category threshold by @rabah-khalek in #1524
- Feature/gsk 1990 add pydantic config ie extra forbid to all dtos by @Hartorn in #1514
- [GSK-2022] Fix Giskard nightly test by @Inokinoki in #1529
- [GSK-1914] Made kwargs default value persistent in the Hub by @kevinmessiaen in #1508
- [GSK-2032] Fix debug master by @Hartorn in #1534
Full Changelog: v2.0.0b29...v2.0.0b30
v2.0.0b29
What's Changed
- Gsk 1816 prompt injection garak by @rabah-khalek in #1460
- LLM special chars injection by @mattbit in #1467
- Feature/gsk 1819 set a minimum on langchains version by @Hartorn in #1507
- Feature/gsk 1942 change the wordings of the contribution push by @kevinmessiaen in #1498
- Avoid uploading default params several times by @Hartorn in #1510
- Feature: LLM scan [GSK-1585, GSK-1815, GSK-1823, GSK-1880, GSK-1881, GSK-1882, GSK-1883, GSK-1910, GSK-1872] by @mattbit in #1468
- Fix Sonar in CI to get coverage back by @Hartorn in #1511
- [GSK-1891][GSK-1967] W&B related updates by @rabah-khalek in #1505
- [GSK-1996] Fixing giskard import by @rabah-khalek in #1515
- Add basic import test by @Hartorn in #1516
- Adding Github action to regenerate Lockfile by @Hartorn in #1506
- Fix
pip
CI job by @mattbit in #1519 - [GSK-1608] Replace 'token' with 'key' when instantiating GiskardClient on demo notebooks by @henchaves in #1520
- [GSK-1978,GSK-1965] LLM scan consolidation by @mattbit in #1513
Full Changelog: v2.0.0b28...v2.0.0b29
v2.0.0b28
Full Changelog: v2.0.0b27...v2.0.0b28
v2.0.0b27
What's Changed
- Little improvements by @Hartorn in #1479
- Improve reporting on robustness/ethical issues [GSK-1765] by @mattbit in #1411
- Use 80 as default port in ML worker by @Inokinoki in #1482
- Added default value for clauses to match backend DTO by @kevinmessiaen in #1483
- Added
function_inputs
toTestSuiteDTO
by @kevinmessiaen in #1485 - [GSK-1508] Add unit tests for WebSocket-based ML Worker communication (python) by @Inokinoki in #1277
- Updating gh md template by @rabah-khalek in #1493
- Fix the excepthook for threads by @Hartorn in #1492
- 1921 & GSK-1851 & GSK-1901 - save langchain chain without ml flow to reduce compatibility by @kevinmessiaen in #1490
- Allow latest pandas version by @Hartorn in #1491
- Show name of transformations performed in CTA by @kevinmessiaen in #1500
- [GSK-1419][GSK-1383] Make dataset, model as suite input in
Suite
and upload them automatically by @Inokinoki in #1499 - GSK-1963: ignore mixpanel errors by @andreybavt in #1502
- GSK-1895 New worker pool by @Hartorn in #1478
Full Changelog: v2.0.0b26...v2.0.0b27
v2.0.0b26
What's Changed
- Fixing option order by @Hartorn in #1477
- [GSK-1770] Fix text explanation for regression model by @Inokinoki in #1475
Full Changelog: v2.0.0b25...v2.0.0b26