Skip to content

Commit

Permalink
Rebuilt the docs
Browse files Browse the repository at this point in the history
  • Loading branch information
ZoranPandovski committed Feb 29, 2024
1 parent 8639758 commit adb5a9e
Show file tree
Hide file tree
Showing 38 changed files with 4,262 additions and 4,284 deletions.
Binary file modified _images/tutorials_custom_explainer_custom_explainer_20_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified _images/tutorials_custom_splitter_custom_splitter_21_0.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified _images/tutorials_custom_splitter_custom_splitter_5_1.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions _sources/index.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ Lightwood works with a variety of data types such as numbers, dates, categories,

Our JSON-AI syntax allows users to change any and all parts of the models Lightwood automatically generates. The syntax outlines the specifics details in each step of the modeling pipeline. Users may override default values (for example, changing the type of a column) or alternatively, entirely replace steps with their own methods (ex: use a random forest model for a predictor). Lightwood creates a "JSON-AI" object from this syntax which can then be used to automatically generate python code to represent your pipeline.

For details as to how Lightwood works, check out the `Lightwood Philosophy <https://lightwood.io/lightwood_philosophy.html>`_ .
For details as to how Lightwood works, check out the `Lightwood Philosophy <https://mindsdb.github.io/lightwood/lightwood_philosophy.html>`_ .

Quick Guide
=======================
Expand Down Expand Up @@ -124,7 +124,7 @@ BYOM: Bring your own models

Lightwood supports user architectures/approaches so long as you follow the abstractions provided within each step.

Our `tutorials <https://lightwood.io/tutorials.html>`_ provide specific use cases for how to introduce customization into your pipeline. Check out "custom cleaner", "custom splitter", "custom explainer", and "custom mixer". Stay tuned for further updates.
Our `tutorials <https://mindsdb.github.io/lightwood/tutorials.html>`_ provide specific use cases for how to introduce customization into your pipeline. Check out "custom cleaner", "custom splitter", "custom explainer", and "custom mixer". Stay tuned for further updates.


Contribute to Lightwood
Expand Down
136 changes: 68 additions & 68 deletions _sources/tutorials/custom_cleaner/custom_cleaner.ipynb.txt
Original file line number Diff line number Diff line change
Expand Up @@ -31,25 +31,25 @@
"id": "happy-wheat",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:28.143176Z",
"iopub.status.busy": "2024-01-23T19:58:28.142697Z",
"iopub.status.idle": "2024-01-23T19:58:30.965992Z",
"shell.execute_reply": "2024-01-23T19:58:30.965188Z"
"iopub.execute_input": "2024-02-29T11:02:15.503091Z",
"iopub.status.busy": "2024-02-29T11:02:15.502888Z",
"iopub.status.idle": "2024-02-29T11:02:18.296106Z",
"shell.execute_reply": "2024-02-29T11:02:18.295457Z"
}
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:lightwood-2886:No torchvision detected, image helpers not supported.\u001b[0m\n"
"\u001b[32mINFO:lightwood-2554:No torchvision detected, image helpers not supported.\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:lightwood-2886:No torchvision/pillow detected, image encoder not supported\u001b[0m\n"
"\u001b[32mINFO:lightwood-2554:No torchvision/pillow detected, image encoder not supported\u001b[0m\n"
]
}
],
Expand Down Expand Up @@ -87,10 +87,10 @@
"id": "recognized-parish",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:30.969559Z",
"iopub.status.busy": "2024-01-23T19:58:30.969174Z",
"iopub.status.idle": "2024-01-23T19:58:32.426952Z",
"shell.execute_reply": "2024-01-23T19:58:32.426222Z"
"iopub.execute_input": "2024-02-29T11:02:18.299506Z",
"iopub.status.busy": "2024-02-29T11:02:18.299102Z",
"iopub.status.idle": "2024-02-29T11:02:19.241721Z",
"shell.execute_reply": "2024-02-29T11:02:19.241028Z"
}
},
"outputs": [
Expand Down Expand Up @@ -221,109 +221,109 @@
"id": "chicken-truth",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:32.429859Z",
"iopub.status.busy": "2024-01-23T19:58:32.429456Z",
"iopub.status.idle": "2024-01-23T19:58:54.854443Z",
"shell.execute_reply": "2024-01-23T19:58:54.853825Z"
"iopub.execute_input": "2024-02-29T11:02:19.244503Z",
"iopub.status.busy": "2024-02-29T11:02:19.244296Z",
"iopub.status.idle": "2024-02-29T11:02:41.643348Z",
"shell.execute_reply": "2024-02-29T11:02:41.642764Z"
}
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:lightwood-2886:Dropping features: ['url_legal', 'license', 'standard_error']\u001b[0m\n"
"\u001b[32mINFO:lightwood-2554:Dropping features: ['url_legal', 'license', 'standard_error']\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Analyzing a sample of 2478\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Analyzing a sample of 2478\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:from a total population of 2834, this is equivalent to 87.4% of your data.\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:from a total population of 2834, this is equivalent to 87.4% of your data.\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Infering type for: id\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Infering type for: id\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Doing text detection for column: id\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Doing text detection for column: id\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Column id has data type categorical\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Column id has data type categorical\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Infering type for: excerpt\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Infering type for: excerpt\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Doing text detection for column: excerpt\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Doing text detection for column: excerpt\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Infering type for: target\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Infering type for: target\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:type_infer-2886:Column target has data type float\u001b[0m\n"
"\u001b[32mINFO:type_infer-2554:Column target has data type float\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[33mWARNING:type_infer-2886:Column id is an identifier of type \"Hash-like identifier\"\u001b[0m\n"
"\u001b[33mWARNING:type_infer-2554:Column id is an identifier of type \"Hash-like identifier\"\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Starting statistical analysis\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Starting statistical analysis\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Dropping features: ['id']\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Dropping features: ['id']\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Finished statistical analysis\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Finished statistical analysis\u001b[0m\n"
]
}
],
Expand Down Expand Up @@ -360,10 +360,10 @@
"id": "designed-condition",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:54.856963Z",
"iopub.status.busy": "2024-01-23T19:58:54.856767Z",
"iopub.status.idle": "2024-01-23T19:58:54.861997Z",
"shell.execute_reply": "2024-01-23T19:58:54.861323Z"
"iopub.execute_input": "2024-02-29T11:02:41.646819Z",
"iopub.status.busy": "2024-02-29T11:02:41.646217Z",
"iopub.status.idle": "2024-02-29T11:02:41.651651Z",
"shell.execute_reply": "2024-02-29T11:02:41.651005Z"
}
},
"outputs": [
Expand Down Expand Up @@ -434,7 +434,7 @@
" \"unbias_target\": true,\n",
" \"seconds_per_mixer\": 21384.0,\n",
" \"seconds_per_encoder\": 85536.0,\n",
" \"expected_additional_time\": 22.386889696121216,\n",
" \"expected_additional_time\": 22.358832359313965,\n",
" \"time_aim\": 259200,\n",
" \"target_weights\": null,\n",
" \"positive_domain\": false,\n",
Expand Down Expand Up @@ -518,10 +518,10 @@
"id": "325d8f1b",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:54.864767Z",
"iopub.status.busy": "2024-01-23T19:58:54.864389Z",
"iopub.status.idle": "2024-01-23T19:58:54.869687Z",
"shell.execute_reply": "2024-01-23T19:58:54.869121Z"
"iopub.execute_input": "2024-02-29T11:02:41.654311Z",
"iopub.status.busy": "2024-02-29T11:02:41.653929Z",
"iopub.status.idle": "2024-02-29T11:02:41.659438Z",
"shell.execute_reply": "2024-02-29T11:02:41.658803Z"
}
},
"outputs": [
Expand Down Expand Up @@ -646,10 +646,10 @@
"id": "f030f8ca",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:54.872215Z",
"iopub.status.busy": "2024-01-23T19:58:54.871838Z",
"iopub.status.idle": "2024-01-23T19:58:54.875034Z",
"shell.execute_reply": "2024-01-23T19:58:54.874504Z"
"iopub.execute_input": "2024-02-29T11:02:41.662332Z",
"iopub.status.busy": "2024-02-29T11:02:41.661886Z",
"iopub.status.idle": "2024-02-29T11:02:41.665256Z",
"shell.execute_reply": "2024-02-29T11:02:41.664597Z"
}
},
"outputs": [],
Expand Down Expand Up @@ -711,10 +711,10 @@
"id": "floating-patent",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:54.877523Z",
"iopub.status.busy": "2024-01-23T19:58:54.877144Z",
"iopub.status.idle": "2024-01-23T19:58:55.077272Z",
"shell.execute_reply": "2024-01-23T19:58:55.076573Z"
"iopub.execute_input": "2024-02-29T11:02:41.667712Z",
"iopub.status.busy": "2024-02-29T11:02:41.667365Z",
"iopub.status.idle": "2024-02-29T11:02:41.865261Z",
"shell.execute_reply": "2024-02-29T11:02:41.864511Z"
}
},
"outputs": [
Expand Down Expand Up @@ -792,7 +792,7 @@
" \"unbias_target\": True,\n",
" \"seconds_per_mixer\": 21384.0,\n",
" \"seconds_per_encoder\": 85536.0,\n",
" \"expected_additional_time\": 22.386889696121216,\n",
" \"expected_additional_time\": 22.358832359313965,\n",
" \"time_aim\": 259200,\n",
" \"target_weights\": None,\n",
" \"positive_domain\": False,\n",
Expand Down Expand Up @@ -1394,10 +1394,10 @@
"id": "violent-guard",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:55.080230Z",
"iopub.status.busy": "2024-01-23T19:58:55.079814Z",
"iopub.status.idle": "2024-01-23T19:58:55.087159Z",
"shell.execute_reply": "2024-01-23T19:58:55.086650Z"
"iopub.execute_input": "2024-02-29T11:02:41.868198Z",
"iopub.status.busy": "2024-02-29T11:02:41.867785Z",
"iopub.status.idle": "2024-02-29T11:02:41.874749Z",
"shell.execute_reply": "2024-02-29T11:02:41.874144Z"
}
},
"outputs": [],
Expand All @@ -1412,10 +1412,10 @@
"id": "closing-episode",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:55.089809Z",
"iopub.status.busy": "2024-01-23T19:58:55.089295Z",
"iopub.status.idle": "2024-01-23T19:58:55.223309Z",
"shell.execute_reply": "2024-01-23T19:58:55.222696Z"
"iopub.execute_input": "2024-02-29T11:02:41.877116Z",
"iopub.status.busy": "2024-02-29T11:02:41.876931Z",
"iopub.status.idle": "2024-02-29T11:02:42.011712Z",
"shell.execute_reply": "2024-02-29T11:02:42.011154Z"
},
"scrolled": false
},
Expand All @@ -1424,70 +1424,70 @@
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Starting statistical analysis\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Starting statistical analysis\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Dropping features: ['id']\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Dropping features: ['id']\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Finished statistical analysis\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Finished statistical analysis\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[37mDEBUG:lightwood-2886: `analyze_data` runtime: 0.05 seconds\u001b[0m\n"
"\u001b[37mDEBUG:lightwood-2554: `analyze_data` runtime: 0.05 seconds\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Cleaning the data\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Cleaning the data\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:dataprep_ml-2886:Dropping features: ['id']\u001b[0m\n"
"\u001b[32mINFO:dataprep_ml-2554:Dropping features: ['id']\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:lightwood-2886:Cleaning column =excerpt\u001b[0m\n"
"\u001b[32mINFO:lightwood-2554:Cleaning column =excerpt\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:lightwood-2886:Cleaning column =target\u001b[0m\n"
"\u001b[32mINFO:lightwood-2554:Cleaning column =target\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[32mINFO:lightwood-2886:Converted target into strictly non-negative\u001b[0m\n"
"\u001b[32mINFO:lightwood-2554:Converted target into strictly non-negative\u001b[0m\n"
]
},
{
"name": "stderr",
"output_type": "stream",
"text": [
"\u001b[37mDEBUG:lightwood-2886: `preprocess` runtime: 0.07 seconds\u001b[0m\n"
"\u001b[37mDEBUG:lightwood-2554: `preprocess` runtime: 0.07 seconds\u001b[0m\n"
]
},
{
Expand Down Expand Up @@ -1577,10 +1577,10 @@
"id": "major-stake",
"metadata": {
"execution": {
"iopub.execute_input": "2024-01-23T19:58:55.225827Z",
"iopub.status.busy": "2024-01-23T19:58:55.225454Z",
"iopub.status.idle": "2024-01-23T19:58:55.230030Z",
"shell.execute_reply": "2024-01-23T19:58:55.229387Z"
"iopub.execute_input": "2024-02-29T11:02:42.014139Z",
"iopub.status.busy": "2024-02-29T11:02:42.013942Z",
"iopub.status.idle": "2024-02-29T11:02:42.019144Z",
"shell.execute_reply": "2024-02-29T11:02:42.018488Z"
}
},
"outputs": [
Expand Down
Loading

0 comments on commit adb5a9e

Please sign in to comment.