Merge pull request #100 from OceanProtocolEnterprise/feat/stage

Feat/stage

Author: AdriGeorge

CHANGELOG.md

@@ -4,9 +4,40 @@ All notable changes to this project will be documented in this file. Dates are d
 
 Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 
+#### [v2.0.2](https://github.com/oceanprotocol/ocean-node/compare/v2.0.1...v2.0.2)
+
+- document publish flow & isolated markets [`#1273`](https://github.com/oceanprotocol/ocean-node/pull/1273)
+- make sure we bill all cases [`#1277`](https://github.com/oceanprotocol/ocean-node/pull/1277)
+
+#### [v2.0.1](https://github.com/oceanprotocol/ocean-node/compare/v2.0.0...v2.0.1)
+
+> 23 March 2026
+
+- fix: payments claim issue [`#1275`](https://github.com/oceanprotocol/ocean-node/pull/1275)
+- fix: remove some fields from getJobs handler response [`#1271`](https://github.com/oceanprotocol/ocean-node/pull/1271)
+- getFile: return proper type [`#1267`](https://github.com/oceanprotocol/ocean-node/pull/1267)
+- refactor fileinfo route & handler [`#1265`](https://github.com/oceanprotocol/ocean-node/pull/1265)
+- Release 2.0.1 [`93740ac`](https://github.com/oceanprotocol/ocean-node/commit/93740acd3f5648484661b0fb65a92b236da6cb7e)
+
+### [v2.0.0](https://github.com/oceanprotocol/ocean-node/compare/v1.0.7...v2.0.0)
+
+> 16 March 2026
+
+- Length prefixed streams [`#1232`](https://github.com/oceanprotocol/ocean-node/pull/1232)
+- feat: update quickstart script & gpu docs [`#1261`](https://github.com/oceanprotocol/ocean-node/pull/1261)
+- add ftp support & upload for url/ftp/s3.  Reorg tests [`#1260`](https://github.com/oceanprotocol/ocean-node/pull/1260)
+- Bump tar from 7.5.10 to 7.5.11 [`#1262`](https://github.com/oceanprotocol/ocean-node/pull/1262)
+- Bump tar from 7.5.8 to 7.5.10 [`#1254`](https://github.com/oceanprotocol/ocean-node/pull/1254)
+- storage cleanup & add S3 Storage for datasets (so far) [`#1256`](https://github.com/oceanprotocol/ocean-node/pull/1256)
+- fix: integration c2d test [`#1212`](https://github.com/oceanprotocol/ocean-node/pull/1212)
+- Release 2.0.0 [`0b852a1`](https://github.com/oceanprotocol/ocean-node/commit/0b852a1241d7dfdbf6db2540a6f3a513e2387111)
+
 #### [v1.0.7](https://github.com/oceanprotocol/ocean-node/compare/v1.0.6...v1.0.7)
 
+> 4 March 2026
+
 - fix query [`#1252`](https://github.com/oceanprotocol/ocean-node/pull/1252)
+- Release 1.0.7 [`a3706e6`](https://github.com/oceanprotocol/ocean-node/commit/a3706e6ab94d38fde78a4fc04dc63afd0f68eefd)
 
 #### [v1.0.6](https://github.com/oceanprotocol/ocean-node/compare/v1.0.5...v1.0.6)
 
@@ -235,28 +266,28 @@ Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 
 > 24 March 2025
 
-- Update node script - C2D [`#896`](https://github.com/oceanprotocol/ocean-node/pull/896)
+- Update node script - C2D  [`#896`](https://github.com/oceanprotocol/ocean-node/pull/896)
 - fix docker-compose [`#895`](https://github.com/oceanprotocol/ocean-node/pull/895)
 - re-indexing old DDOs [`#867`](https://github.com/oceanprotocol/ocean-node/pull/867)
 - Upgrade tsx dep to v4.x [`#893`](https://github.com/oceanprotocol/ocean-node/pull/893)
 - C2D Docker [`#705`](https://github.com/oceanprotocol/ocean-node/pull/705)
 - Updating codeowners [`#887`](https://github.com/oceanprotocol/ocean-node/pull/887)
-- fix issue with empty nft fields [`#886`](https://github.com/oceanprotocol/ocean-node/pull/886)
+- fix issue with empty  nft fields [`#886`](https://github.com/oceanprotocol/ocean-node/pull/886)
 - add allowed admins access list [`#841`](https://github.com/oceanprotocol/ocean-node/pull/841)
 - Update error message for invalid peer connection [`#874`](https://github.com/oceanprotocol/ocean-node/pull/874)
 - add AUTHORIZED_DECRYPTERS_LIST [`#836`](https://github.com/oceanprotocol/ocean-node/pull/836)
 - fix status code if policy server not available [`#869`](https://github.com/oceanprotocol/ocean-node/pull/869)
-- Fix DDO: Stats and Prices for exchanges/dispensers [`#774`](https://github.com/oceanprotocol/ocean-node/pull/774)
+- Fix DDO: Stats and Prices for exchanges/dispensers  [`#774`](https://github.com/oceanprotocol/ocean-node/pull/774)
 - move p2p getters as handlers [`#862`](https://github.com/oceanprotocol/ocean-node/pull/862)
 - always check remote peerId [`#864`](https://github.com/oceanprotocol/ocean-node/pull/864)
 - Test if dashboard changes are already committed [`#842`](https://github.com/oceanprotocol/ocean-node/pull/842)
-- add AUTHORIZED*PUBLISHERS*\*\*\* env variables [`#826`](https://github.com/oceanprotocol/ocean-node/pull/826)
+- add AUTHORIZED_PUBLISHERS_*** env variables [`#826`](https://github.com/oceanprotocol/ocean-node/pull/826)
 - Issue 814 credentials types [`#823`](https://github.com/oceanprotocol/ocean-node/pull/823)
 - remove echo command [`#839`](https://github.com/oceanprotocol/ocean-node/pull/839)
 - Issue 808 - new accesslist credentials type [`#819`](https://github.com/oceanprotocol/ocean-node/pull/819)
 - add ALLOWED_VALIDATORS_LIST [`#829`](https://github.com/oceanprotocol/ocean-node/pull/829)
 - update build files and hash [`#821`](https://github.com/oceanprotocol/ocean-node/pull/821)
-- add \* as match all rule for address types [`#837`](https://github.com/oceanprotocol/ocean-node/pull/837)
+- add * as match all rule for address types [`#837`](https://github.com/oceanprotocol/ocean-node/pull/837)
 - fix: return correct message on policy server call [`#834`](https://github.com/oceanprotocol/ocean-node/pull/834)
 - add policyServerPassthrough routes [`#832`](https://github.com/oceanprotocol/ocean-node/pull/832)
 - Bump fast-xml-parser from 4.3.6 to 4.5.0 in /dashboard [`#711`](https://github.com/oceanprotocol/ocean-node/pull/711)
@@ -292,7 +323,7 @@ Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 - fix system tests. Running old version of node? [`#733`](https://github.com/oceanprotocol/ocean-node/pull/733)
 - rm console.logs [`#731`](https://github.com/oceanprotocol/ocean-node/pull/731)
 - fix wrong block for log [`#727`](https://github.com/oceanprotocol/ocean-node/pull/727)
-- nonce db sql lite [`#723`](https://github.com/oceanprotocol/ocean-node/pull/723)
+- nonce db sql lite  [`#723`](https://github.com/oceanprotocol/ocean-node/pull/723)
 - Bump version axios 1.6.0 -> 1.7.4. [`#716`](https://github.com/oceanprotocol/ocean-node/pull/716)
 - Bump version express 4.18.2 -> 4.21.0. [`#717`](https://github.com/oceanprotocol/ocean-node/pull/717)
 - Feature/ add Elasticsearch database alternative for typesense [`#599`](https://github.com/oceanprotocol/ocean-node/pull/599)
@@ -301,7 +332,7 @@ Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 - Bump micromatch from 4.0.5 to 4.0.8 in /dashboard [`#649`](https://github.com/oceanprotocol/ocean-node/pull/649)
 - Bump undici from 5.27.0 to 5.28.4 [`#610`](https://github.com/oceanprotocol/ocean-node/pull/610)
 - testing changes [`#718`](https://github.com/oceanprotocol/ocean-node/pull/718)
-- Policy Server [`#694`](https://github.com/oceanprotocol/ocean-node/pull/694)
+- Policy Server  [`#694`](https://github.com/oceanprotocol/ocean-node/pull/694)
 - fix missing/invalid db_url log message, put warn at startup [`#654`](https://github.com/oceanprotocol/ocean-node/pull/654)
 - move c2d engines under OceanNode class [`#702`](https://github.com/oceanprotocol/ocean-node/pull/702)
 - improve error message, transfer fees and tweak node response [`#701`](https://github.com/oceanprotocol/ocean-node/pull/701)
@@ -431,7 +462,7 @@ Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 - Differentiate error messages indexer [`#570`](https://github.com/oceanprotocol/ocean-node/pull/570)
 - Issue 565 optimize get status [`#566`](https://github.com/oceanprotocol/ocean-node/pull/566)
 - fix get indexing queue [`#564`](https://github.com/oceanprotocol/ocean-node/pull/564)
-- Changes on logging transports (.env var based locations) [`#553`](https://github.com/oceanprotocol/ocean-node/pull/553)
+- Changes on logging transports (.env var based locations)  [`#553`](https://github.com/oceanprotocol/ocean-node/pull/553)
 - Check if ddo state is active before executing node's commands. [`#542`](https://github.com/oceanprotocol/ocean-node/pull/542)
 - use static rpc provider [`#548`](https://github.com/oceanprotocol/ocean-node/pull/548)
 - Fix downloading full content of the file. [`#559`](https://github.com/oceanprotocol/ocean-node/pull/559)
@@ -485,7 +516,7 @@ Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 - Remove chain id from get compute envs task. [`#460`](https://github.com/oceanprotocol/ocean-node/pull/460)
 - Issue 397 warn env db logs [`#457`](https://github.com/oceanprotocol/ocean-node/pull/457)
 - fix p2p peers [`#449`](https://github.com/oceanprotocol/ocean-node/pull/449)
-- c2d v2 arhitecture [`#381`](https://github.com/oceanprotocol/ocean-node/pull/381)
+- c2d v2 arhitecture  [`#381`](https://github.com/oceanprotocol/ocean-node/pull/381)
 - Fix: dashboard failing build if NODE_ENV is changed [`#450`](https://github.com/oceanprotocol/ocean-node/pull/450)
 - Dashboard: get ocean peers polling [`#445`](https://github.com/oceanprotocol/ocean-node/pull/445)
 - Replace hardcoded values in Dashboard [`#444`](https://github.com/oceanprotocol/ocean-node/pull/444)
@@ -564,15 +595,15 @@ Generated by [`auto-changelog`](https://github.com/CookPete/auto-changelog).
 - Provider fees compute [`#252`](https://github.com/oceanprotocol/ocean-node/pull/252)
 - Updates to package.json bringing it in line with our other repositories [`#260`](https://github.com/oceanprotocol/ocean-node/pull/260)
 - Issue 205 ddo handling [`#239`](https://github.com/oceanprotocol/ocean-node/pull/239)
-- fix error on publish + no signer/no account / metadata events error [`#255`](https://github.com/oceanprotocol/ocean-node/pull/255)
+- fix error on publish + no signer/no account  /  metadata events error [`#255`](https://github.com/oceanprotocol/ocean-node/pull/255)
 - add config option for network interfaces, p2p and http [`#248`](https://github.com/oceanprotocol/ocean-node/pull/248)
 - Feature/ Add handle decrypt method [`#221`](https://github.com/oceanprotocol/ocean-node/pull/221)
 - Added checks for metadata events. [`#237`](https://github.com/oceanprotocol/ocean-node/pull/237)
 - Create collections specific for ddo versions [`#225`](https://github.com/oceanprotocol/ocean-node/pull/225)
 - Move commands from constants.ts to @types/commands.ts [`#244`](https://github.com/oceanprotocol/ocean-node/pull/244)
 - Issue 227 get environments [`#238`](https://github.com/oceanprotocol/ocean-node/pull/238)
 - fix unit test on commands.ts - pick mismatches in both directions [`#246`](https://github.com/oceanprotocol/ocean-node/pull/246)
-- Expose validateDDO on http [`#234`](https://github.com/oceanprotocol/ocean-node/pull/234)
+- Expose validateDDO on http  [`#234`](https://github.com/oceanprotocol/ocean-node/pull/234)
 - Missing param validation for directCommand DOWNLOAD [`#242`](https://github.com/oceanprotocol/ocean-node/pull/242)
 - add c2d in ci [`#241`](https://github.com/oceanprotocol/ocean-node/pull/241)
 - add C2C cluster env config [`#240`](https://github.com/oceanprotocol/ocean-node/pull/240)

docs/API.md

@@ -1463,6 +1463,7 @@ starts a free compute job and returns jobId if succesfull
 | additionalViewers           | object |          | optional array of addresses that are allowed to fetch the result                                                                                                            |
 | queueMaxWaitTime            | number |          | optional max time in seconds a job can wait in the queue before being started                                                                                               |
 | encryptedDockerRegistryAuth | string |          | Ecies encrypted docker auth schema for image (see [Private Docker Registries with Per-Job Authentication](../env.md#private-docker-registries-with-per-job-authentication)) |
+| output                      | string |          | Ecies encrypted with instructions for uploading compute results (see [C2D result upload to remote storage](../Storage.md#c2d-result-upload-to-remote-storage))              |
 
 #### Request
 

docs/GPU.md

@@ -37,9 +37,9 @@ Fri Apr 25 06:00:34 2025
 Now, time to get the id of the gpu:
 
 ```bash
-root@gpu-1:/repos/ocean/ocean-node# nvidia-smi --query-gpu=name,uuid --format=csv
-name, uuid
-NVIDIA GeForce GTX 1060 3GB, GPU-294c6802-bb2f-fedb-f9e0-a26b9142dd81
+root@gpu-1:/repos/ocean/ocean-node# nvidia-smi --query-gpu=name,uuid,driver_version,memory.total --format=csv
+name, uuid, driver version, memory total
+NVIDIA GeForce GTX 1060 3GB, GPU-294c6802-bb2f-fedb-f9e0-a26b9142dd81, 570.195.03, 3072 MiB
 ```
 
 Now, we can define the gpu for node:
@@ -56,7 +56,9 @@ Now, we can define the gpu for node:
       "DeviceIDs": ["GPU-294c6802-bb2f-fedb-f9e0-a26b9142dd81"],
       "Capabilities": [["gpu"]]
     }
-  }
+  },
+  "driverVersion": "570.195.03",
+  "memoryTotal": "3072 MiB"
 }
 ```
 
@@ -80,7 +82,9 @@ Here is the full definition of DOCKER_COMPUTE_ENVIRONMENTS:
             "DeviceIDs": ["GPU-294c6802-bb2f-fedb-f9e0-a26b9142dd81"],
             "Capabilities": [["gpu"]]
           }
-        }
+        },
+        "driverVersion": "570.195.03",
+        "memoryTotal": "3072 MiB"
       },
       { "id": "disk", "total": 1 }
     ],
@@ -93,7 +97,7 @@ Here is the full definition of DOCKER_COMPUTE_ENVIRONMENTS:
           "feeToken": "0x123",
           "prices": [
             { "id": "cpu", "price": 1 },
-            { "id": "nyGPU", "price": 3 }
+            { "id": "myGPU", "price": 3 }
           ]
         }
       ]
@@ -161,6 +165,8 @@ root@gpu-1:/repos/ocean/ocean-node# curl http://localhost:8000/api/services/comp
             "Capabilities": [["gpu"]]
           }
         },
+        "driverVersion": "570.195.03",
+        "memoryTotal": "3072 MiB",
         "max": 1,
         "min": 0,
         "inUse": 0
@@ -259,7 +265,9 @@ Then define DOCKER_COMPUTE_ENVIRONMENTS with
               "seccomp": "unconfined"
             }
           }
-        }
+        },
+        "driverVersion": "26.2.2",
+        "memoryTotal": "16384 MiB"
       },
       {
         "id": "disk",
@@ -316,8 +324,7 @@ Then define DOCKER_COMPUTE_ENVIRONMENTS with
 aka
 
 ```bash
-export DOCKER_COMPUTE_ENVIRONMENTS="[{\"socketPath\":\"/var/run/docker.sock\",\"resources\":[{\"id\":\"myGPU\",\"description\":\"AMD Radeon RX 9070 XT\",\"type\":\"gpu\",\"total\":1,\"init\":{\"advanced\":{
-\"IpcMode\":\"host\",\"CapAdd\":[\"CAP_SYS_PTRACE\"],\"Devices\":[\"/dev/dxg\",\"/dev/dri/card0\"],\"Binds\":[\"/usr/lib/wsl/lib/libdxcore.so:/usr/lib/libdxcore.so\",\"/opt/rocm/lib/libhsa-runtime64.so.1:/opt/rocm/lib/libhsa-runtime64.so.1\"],\"SecurityOpt\":{\"seccomp\":\"unconfined\"}}}},{\"id\":\"disk\",\"total\":10}],\"storageExpiry\":604800,\"maxJobDuration\":3600,\"minJobDuration\":60,\"fees\":{\"1\":[{\"feeToken\":\"0x123\",\"prices\":[{\"id\":\"cpu\",\"price\":1},{\"id\":\"nyGPU\",\"price\":3}]}]},\"free\":{\"maxJobDuration\":60,\"minJobDuration\":10,\"maxJobs\":3,\"resources\":[{\"id\":\"cpu\",\"max\":1},{\"id\":\"ram\",\"max\":1},{\"id\":\"disk\",\"max\":1},{\"id\":\"myGPU\",\"max\":1}]}}]"
+export DOCKER_COMPUTE_ENVIRONMENTS='[{"socketPath":"/var/run/docker.sock","resources":[{"id":"myGPU","description":"AMD Radeon RX 9070 XT","type":"gpu","total":1,"init":{"advanced":{"IpcMode":"host","ShmSize":8589934592,"CapAdd":["SYS_PTRACE"],"Devices":["/dev/dxg","/dev/dri/card0"],"Binds":["/usr/lib/wsl/lib/libdxcore.so:/usr/lib/libdxcore.so","/opt/rocm/lib/libhsa-runtime64.so.1:/opt/rocm/lib/libhsa-runtime64.so.1"],"SecurityOpt":{"seccomp":"unconfined"}}},"driverVersion":"26.2.2","memoryTotal":"16384 MiB"},{"id":"disk","total":1}],"storageExpiry":604800,"maxJobDuration":3600,"minJobDuration":60,"fees":{"1":[{"feeToken":"0x123","prices":[{"id":"cpu","price":1},{"id":"nyGPU","price":3}]}]},"free":{"maxJobDuration":60,"minJobDuration":10,"maxJobs":3,"resources":[{"id":"cpu","max":1},{"id":"ram","max":1},{"id":"disk","max":1},{"id":"myGPU","max":1}]}}]'
 ```
 
 you should have it in your compute envs:
@@ -390,6 +397,8 @@ root@gpu-1:/repos/ocean/ocean-node# curl http://localhost:8000/api/services/comp
             }
           }
         },
+        "driverVersion": "26.2.2",
+        "memoryTotal": "16384 MiB",
         "max": 1,
         "min": 0,
         "inUse": 0
@@ -541,7 +550,9 @@ Now, we can define the GPU for the node:
       "GroupAdd": ["video", "render"],
       "CapAdd": ["SYS_ADMIN"]
     }
-  }
+  },
+  "driverVersion": "32.0.101.8531",
+  "memoryTotal": "16384 MiB"
 }
 ```
 
@@ -563,7 +574,9 @@ Here is the full definition of DOCKER_COMPUTE_ENVIRONMENTS with Intel GPU:
             "GroupAdd": ["video", "render"],
             "CapAdd": ["SYS_ADMIN"]
           }
-        }
+        },
+        "driverVersion": "32.0.101.8531",
+        "memoryTotal": "16384 MiB"
       },
       { "id": "disk", "total": 1 }
     ],
@@ -644,6 +657,8 @@ root@gpu-1:/repos/ocean/ocean-node# curl http://localhost:8000/api/services/comp
             "CapAdd": ["SYS_ADMIN"]
           }
         },
+        "driverVersion": "32.0.101.8531",
+        "memoryTotal": "16384 MiB"
         "max": 1,
         "min": 0,
         "inUse": 0