Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] release-2024b from opendatahub-io:2024b #453

Closed
wants to merge 52 commits into from

Conversation

pull[bot]
Copy link

@pull pull bot commented Nov 28, 2024

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.1)

Can you help keep this open source service alive? 💖 Please sponsor : )

jiridanek and others added 3 commits November 28, 2024 16:25
…ebooks Github Actions (#775)

* RHOAIENG-16076: tests(gha): run Makefile tests in GitHub Actions

* fixup, looks like I lost the second changed line from #761 (comment) when merging the work

* fixup, linter wants space in the comments; IntelliJ is ok with it, so let's do that

* fixup, add reference to OpenShift CI for the source of the make invocations

* fixup, the ifNotPresent pull policy (for PR checks without image registry) and the symbolic links apparently needed to deploy rocm stuff
[Digest Updater Action] Update Runtimes Images
Copy link

openshift-ci bot commented Nov 28, 2024

Hi @pull[bot]. Thanks for your PR.

I'm waiting for a red-hat-data-services member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@atheo89
Copy link
Member

atheo89 commented Nov 29, 2024

This commit
image

Cause the conflicts. We should work on https://issues.redhat.com/browse/RHOAIENG-15392 to fix all these

github-actions bot and others added 19 commits November 29, 2024 10:45
[Digest Updater Action] Update Notebook Images
[Digest Updater Action] Update Runtimes Images
… the whole repo, so we can start reusing code between images in the future (#792)

* Update `COPY` commands in all not-intel Dockerfiles

* Update `COPY` commands in intel Dockerfiles too

* RHOAIENG-11274: chore(Makefile): widen the container build context to the whole repo, so we can start reusing code between images in the future

```python
import glob
import pathlib

def main():
    for dockerfile in glob.glob("**/Dockerfile", recursive=True):
        print(dockerfile)
        path = pathlib.Path(dockerfile)
        lines = path.read_text().splitlines()
        idx = lines.index("ARG SOURCE_CODE=.")
        lines[idx] = f"ARG SOURCE_CODE={str(path.parent)}"
        print("\t", lines[idx])
        path.write_text("\n".join(lines) + "\n")

if __name__ == '__main__':
    main()
```

* Adjust Makefile to build in `ROOT_DIR` and create .dockerignore to save time when initializing builds
…ner code using the improvements put into place just before (#801)
…s can only access files we know they access (#803)
Remove old obsolete files

Include codeserver notebook on the refresh-piplock-files recipe

Update refresh-pipfilelock-files to accept optional file directories for updates

Update documentation in regards the Pipfile lock generation
Update Piplock Renewal GitHub Action
…AGS := -eu -o pipefail -c` in Makefile (#791)

* RHOAIENG-16403: chore(Makefile): implement `.ONESHELL:` and `.SHELLFLAGS := -eu -o pipefail -c` in Makefile

* fixups for proper shell error handling
openshift-merge-bot bot and others added 26 commits December 17, 2024 15:52
Make the pipfile renewal to work when cron firing
…70.0.0 for CVE fixes (#807)

* updated setuptools to 70.0.0 for CVE fixes

* Update Pipfile.lock files by piplock-renewal.yaml action

* Update Pipfile.lock files by piplock-renewal.yaml action

---------

Co-authored-by: GitHub Actions <github-actions[bot]@users.noreply.github.com>
Adding my own GH handle (`andyatmiami`) to the `approvers` and `reviewers` section of `OWNERS`, honor alphanumeric sorting, so I can be more self-sufficient in working issues alongside the team.
NO-JIRA: chore(gha): run code-server playwright tests for pushes (and scheduled run) as well
NO-ISSUE: chore(owners): add myself as reviewer/approver
NO-JIRA: chore(tests): use gmake on macOS
* RHOAIENG-16415: chore(notebooks): remove unreferenced 3.9 images

These images are not referenced in our 2024b Manifests and can be removed.

* fixup update ancillary files
…, setting them in R global env file.

Also changed env var search to beginning-of-line regex format for all env vars.

Signed-off-by: shalberd <[email protected]>
Pin `jupyterlab` package to version `4.2.6`
…r_proxyenv_vars_available_REnviron

RHOAIENG-16604: feat(RStudio): grab proxy-related env vars from container env context and set them in R default environment
…ndering_work

RHOAIENG-17256: install necessary base OS package to make Knit rendering of R markup to PDF possible
The current method of using `sed` to modify `kustomization.yaml` when running the `deploy9-` `Makefile` target runs into issues if the developer workstation is on MacOS.

Given the intended behavior here is to swap out a couple values in the `yaml` file - this PR adds `yq` as a self-contained dependency to the `Makefile` to handle this `yaml` modification.

The `bin/yq` target added to `Makefile` follows the existing conventions established around the `bin/kubectl` handling within the `Makefile`.
This commit adds `kubeflow-training[huggingface]` to the following workbench images:
- `./jupyter/datascience/ubi9-python-3.11`
- `./jupyter/pytorch/ubi9-python-3.11`
- `./jupyter/rocm/pytorch/ubi9-python-3.11`
- `./jupyter/trustyai/ubi9-python-3.11`
- `./codeserver/ubi9-python-3.11`

This outcome comes with a slew of caveats and disclaimers:
- Due to a dependency conflict, `codeflare-sdk==0.24.3` was **also** pulled into the following workbench images.
	- `./jupyter/datascience/ubi9-python-3.11`
	- `./jupyter/pytorch/ubi9-python-3.11`
	- `./jupyter/rocm/pytorch/ubi9-python-3.11`
	- `./jupyter/trustyai/ubi9-python-3.11`
- ⚠️ In what may be a "controversial" decision, `codeflare-sdk` was **NOT** updated on other workbench images.  Since `0.24.3` was a "one-off" release to unblock the `kubeflow-training` inclusion - the thought process here is that normal "sync" procedures on the next official release will standardize the `codeflare-sdk` dependency across all workbench images.  This allows us to restrict the testing effort of this commit.
    - However, as of 2bd35f7, `codeflare-sdk` `0.24.3` was being pulled into our `Pipfile.lock` file - which is why you won't see `Pipfile.lock` addition of `codeflare-sdk` on **this PR**
- `jupyter/minmal/ubi9-python-3.11` was deliberately excluded from receiving `kubeflow-training` per discussions with team.
- Due to dependency conflicts discovered `tensorflow`-based workbench images,`kubeflow-training` has not been added to those workbench images at this time.  This decision was agreed to by affect stakeholders.  Core blocking issue can be seen here:
	- See #2328 in https://github.com/onnx/tensorflow-onnx/issues
- Due to a dependency conflict, `transformers = "==4.38.0"` was **also** added to the`./jupyter/trustyai/ubi9-python-3.11` workbench image after discussion with the developer that last worked on the `trustyai` image.  While it certainly must be tested, there was no strict requirement that necessitated pinning the `transformers` dependency to `4.36.2` - and the `huggingface` `extras` now introduces a `4.38.0` constraint for `transformers`.

Related-to: https://issues.redhat.com/browse/RHOAIENG-12822
feat(deps): add kubeflow-training to workbench images
NO-JIRA: fix(build): use yq to modify kustomization.yaml during deploy targets
Updated notebooks via odh-sync-updater-12711100946 GitHub action
Sync `2024b` branch with `main` branch
Copy link

openshift-ci bot commented Jan 15, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign daniellutz for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@atheo89
Copy link
Member

atheo89 commented Jan 15, 2025

replaced by: #480

@atheo89 atheo89 closed this Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants