Skip to content
Draft
Show file tree
Hide file tree
Changes from 115 commits
Commits
Show all changes
156 commits
Select commit Hold shift + click to select a range
93f9cda
#224 Added basic conda build recipe and build script.
May 5, 2023
623c055
Merge remote-tracking branch 'chris_fork/224.conda' into 347-conda-pa…
ilaflott Jan 30, 2025
5f61648
add build_conda
ilaflott Jan 30, 2025
5df2f0b
disable workflows i am not touching- add jinja to meta.yaml to grab g…
ilaflott Jan 30, 2025
7ea36da
use the fre-cli container with miniconda installed instead
ilaflott Jan 30, 2025
9c80fb8
remove git tag jinja2 reference... apparently that needs a setup.py a…
ilaflott Jan 30, 2025
9719b46
comment out matrix running for now- add appropriate conda-forge packa…
ilaflott Jan 30, 2025
f59330d
update build reqs- adjust build target for hdf5 library, add openmp
ilaflott Jan 30, 2025
481a1bd
add tcsh
ilaflott Jan 30, 2025
6298e24
Create split_ncvars.pl.1
ilaflott Feb 10, 2025
dde7244
Update Makefile.am
ilaflott Feb 10, 2025
5c8c20b
Update build.sh
ilaflott Feb 10, 2025
3415a99
guard against lack of split_ncvars man page in conda package, at auto…
ilaflott Feb 10, 2025
c054d77
remove non-existant option in configure call. re-autoconfigure in tes…
ilaflott Feb 10, 2025
de7c204
Merge branch 'main' into 347-conda-packaging-reboot
ilaflott Sep 17, 2025
6b462bc
unparallelize the build for simplicity, line up the conda build envir…
ilaflott Sep 17, 2025
5011e5b
remove defaults channel just in case, and realllllly get the conda bu…
ilaflott Sep 17, 2025
f35a178
forget netcdf4 for a minute
ilaflott Sep 17, 2025
92fa3e1
choose the fre-nctools container instead of the fre-cli one. restore …
ilaflott Sep 17, 2025
bd9dfc3
fine, disable all the workflows other than the conda building one. i …
ilaflott Sep 17, 2025
be1a281
ok, back to fre-cli container...
ilaflott Sep 17, 2025
6e44dd0
back to normal conda-verify and conda-build
ilaflott Sep 17, 2025
e1eb0ea
this should fix the docbook oriented complaint
ilaflott Sep 17, 2025
64dcdb9
simplify metayaml recipe a touch
ilaflott Sep 17, 2025
b45b5fb
further simplify env. also specifically ask for python 3
ilaflott Sep 17, 2025
98c162d
closer...
ilaflott Sep 17, 2025
a934edb
try without autoreconf
ilaflott Sep 17, 2025
34ce960
closer... try testing as part of the build. not conda canon, but oh wlel
ilaflott Sep 17, 2025
aedaf5d
so close
ilaflott Sep 17, 2025
f5aeefb
cmooooon!
ilaflott Sep 17, 2025
21e1df6
CMOOON
ilaflott Sep 17, 2025
aba7f8a
Initial plan
Copilot Sep 17, 2025
da32f41
Fix conda package tests to avoid make check in test phase
Copilot Sep 17, 2025
a23578e
Add comprehensive conda package tests for key FRE-NCtools programs
Copilot Sep 17, 2025
2c78f41
Update build_conda workflow trigger to push
ilaflott Sep 18, 2025
0ff892d
Uncomment main.yml workflow and add functional tests for timavg and c…
Copilot Sep 18, 2025
4b3a11f
Simplify conda tests to use single-line commands instead of multiline…
Copilot Sep 18, 2025
f8b7514
Re-comment main.yml workflow and fix meta.yaml tests to use make chec…
Copilot Sep 18, 2025
02e53c5
Fix conda test autoreconf issue by using simple functional tests with…
Copilot Sep 18, 2025
0d0b028
Revert "Fix conda test autoreconf issue by using simple functional te…
ilaflott Sep 18, 2025
968c6b5
Merge pull request #376 from NOAA-GFDL/copilot/fix-34729303-cdef-45a4…
ilaflott Sep 18, 2025
cf93f7e
clearly print out some helpful info
ilaflott Sep 18, 2025
937047a
Include source_files for testing configuration
ilaflott Sep 18, 2025
9ff9653
Add source files for testing in meta.yaml
ilaflott Sep 18, 2025
5e840e3
Refactor test environment setup commands
ilaflott Sep 18, 2025
3ad0c66
Add source files pattern to test configuration
ilaflott Sep 18, 2025
4723b0e
Update test source files in meta.yaml
ilaflott Sep 18, 2025
4de8a9e
Add man directory to test source files
ilaflott Sep 18, 2025
bf77ac3
Refactor requirements in meta.yaml
ilaflott Sep 18, 2025
2430409
Update meta.yaml
ilaflott Sep 18, 2025
208cdae
Update meta.yaml with additional conda requirements
ilaflott Sep 18, 2025
087afde
local build on workstation quite similar to build in pipeline now! cl…
ilaflott Sep 19, 2025
c43952d
undo older edits to files, unsure if necessary
ilaflott Sep 19, 2025
977a570
delete a file i created to fix idk what. update env yaml, maybe i wil…
ilaflott Sep 19, 2025
b94005d
missed a bit
ilaflott Sep 19, 2025
3e7f83b
lets not get too complicated too quick
ilaflott Sep 19, 2025
de3dc9a
syntax for flag and lets try the --test flag and see what happens
ilaflott Sep 19, 2025
65b092f
forget splitting the build and test step for a minute... sigh
ilaflott Sep 19, 2025
90b453f
syntax error?
ilaflott Sep 19, 2025
46736fa
comment out the test section for a second, lets see what happens
ilaflott Sep 19, 2025
3e20bca
bring back testing step and exit guard the make check. copy log file …
ilaflott Sep 19, 2025
124f81a
fix tarball path, uncomment test-suite.log upload that we are gonna t…
ilaflott Sep 19, 2025
1324832
friday YOLO: try the build directory option.
ilaflott Sep 19, 2025
e41eaa3
Enhance build script output messages
ilaflott Sep 22, 2025
64387f7
Update conda build command with debug option
ilaflott Sep 22, 2025
7495052
Revert "Update conda build command with debug option"
ilaflott Sep 22, 2025
3f56785
Revert "Enhance build script output messages"
ilaflott Sep 22, 2025
fea46cc
Revert "friday YOLO: try the build directory option."
ilaflott Sep 22, 2025
acf7ed4
Revert "fix tarball path, uncomment test-suite.log upload that we are…
ilaflott Sep 22, 2025
1e7d399
Revert "bring back testing step and exit guard the make check. copy l…
ilaflott Sep 22, 2025
118bfa9
Revert "comment out the test section for a second, lets see what happ…
ilaflott Sep 22, 2025
85871cb
re-introduce potentially offensive line into metayaml, and also a ha…
ilaflott Sep 22, 2025
11ec177
try reintroducing the correct path for the tarball in the artifact up…
ilaflott Sep 22, 2025
3bd00f6
now turn on the test-suite log uploading
ilaflott Sep 22, 2025
209f6fe
emacs' whitespace-cleanup on OSX is introducing weird whitespace char…
ilaflott Sep 22, 2025
5469a5d
re-do the test-suite log upload bit
ilaflott Sep 22, 2025
49fc134
many errors in the test-suite.log seem related to GLIBCXX and CXXABI …
ilaflott Sep 22, 2025
96439e4
ugh whitespace killing me
ilaflott Sep 22, 2025
2a86e69
try pinning the gcc compiler. try setting the LD_LIBRARY_PATH to PREF…
ilaflott Sep 22, 2025
3b58051
shot in the dark- remove openmp and mpi packages
ilaflott Sep 22, 2025
e8ed381
put mpich (implementation of mpi on conda-forge) back in reqs
ilaflott Sep 22, 2025
73cb808
libhdf5 add in...
ilaflott Sep 22, 2025
06d73de
correct the hdf5 req
ilaflott Sep 22, 2025
c572fa5
correct the hdf5 req... again
ilaflott Sep 22, 2025
9ac299b
fix gcc version to whats in the container
ilaflott Sep 22, 2025
8f10580
remove gcc req, just use whatever is in the container.. re-add back i…
ilaflott Sep 22, 2025
933aa44
i think the ld_library_path thing is not gonna work for us...
ilaflott Sep 22, 2025
4ae2956
exploring guidance from Mikyung, and Frank
ilaflott Sep 25, 2025
a577015
typo and apparently udunits 2.2.28 has not made it to conda-forge yet
ilaflott Sep 25, 2025
a6c8cc6
loosen some reqs in env yaml
ilaflott Sep 25, 2025
c4c72e4
tweak meta and env
ilaflott Sep 25, 2025
267c241
conda-forge udunits is weird...
ilaflott Sep 25, 2025
30ab51c
lets try configuring with nf-config and nc-config
ilaflott Sep 25, 2025
a585afc
temporarily remove the workflow files so i can stop getting emails ab…
ilaflott Sep 25, 2025
bb13094
try uploading test-suite log first before the tarball for now, becaus…
ilaflott Sep 25, 2025
6e0f08d
lets try one with a proper minforge container too
ilaflott Sep 25, 2025
eaf4ccd
typo for the host of the miniforge3 container
ilaflott Sep 25, 2025
fb5392d
miniforge container a little more testy about channels etc. thankfull…
ilaflott Sep 25, 2025
653f8ec
there is no conda-verify for conda-forge
ilaflott Sep 25, 2025
3ebb81d
matrix of images, a fre-cli one and the miniforge3 one. add make as a…
ilaflott Sep 25, 2025
318c466
stop killing my workflows!
ilaflott Sep 25, 2025
57615ba
update autoconf and automake reqs for miniforge container. also uncom…
ilaflott Sep 25, 2025
c0af661
put the prefix back in configure
ilaflott Sep 25, 2025
0b3cdd1
CLOSER!!!
ilaflott Sep 25, 2025
5d10cc9
add coreutils req
ilaflott Sep 25, 2025
b0a36df
Revert "add coreutils req"
ilaflott Sep 26, 2025
4c3efea
add commented out module loads and PREFIX for local building on works…
ilaflott Sep 26, 2025
bc64a01
homing in, edits based on feedback from @ceblanton conda install test…
ilaflott Sep 26, 2025
38e45c5
tweak reqs and avoid tempest-remap 2.2.0
ilaflott Sep 26, 2025
64cc86b
fix typo, BUILD_DIR --> BUILD_PREFIX
ilaflott Sep 26, 2025
14e23f8
OK... redundant reqs it is
ilaflott Sep 26, 2025
67038e0
crazy idea after noticing the only files in the fre-nctools conda-ins…
ilaflott Sep 26, 2025
641b3ac
avoid the one dir with the one file with the symbolic link
ilaflott Sep 26, 2025
43f7077
include the libraries and their versions explicitly
ilaflott Sep 26, 2025
a26c79d
toss in perl5 to the build- it seesm the miniforge container wanted t…
ilaflott Sep 26, 2025
ebda780
and with reckless abandon, we continue.
ilaflott Sep 26, 2025
b69d4cf
avoid thingy holding symbolic link that conda hates
ilaflott Sep 26, 2025
3e1a56c
update env reqs slightly, remove export its useless, recall nf-config…
ilaflott Sep 26, 2025
bb4b545
im sorry for asking you to fit asciidoc into your environemnt, i dont…
ilaflott Sep 26, 2025
55219d8
Refactor build.sh to use PREFIX variable
ilaflott Sep 30, 2025
4be385c
Revert "im sorry for asking you to fit asciidoc into your environemnt…
ilaflott Sep 30, 2025
ec4d735
Revert "update env reqs slightly, remove export its useless, recall n…
ilaflott Sep 30, 2025
92e48e4
make the flag setting consistent
ilaflott Sep 30, 2025
e147835
align build reqs
ilaflott Sep 30, 2025
8912bbe
only use the fre-cli container for now, so that tarball gets uploaded…
ilaflott Oct 1, 2025
f8a5cc2
Change image definition to array format in workflow
ilaflott Oct 1, 2025
614da66
weird req bug when specifying a patch version wildcard that doesnt ex…
ilaflott Oct 1, 2025
cd004cd
force python to be 3.11 like fre-cli. avoid specific build of tempest…
ilaflott Oct 1, 2025
f9a257a
syntax for version/build pinning
ilaflott Oct 1, 2025
95a9933
ugh
ilaflott Oct 1, 2025
9d7e9ae
FINE
ilaflott Oct 1, 2025
ad2aab3
please be the right syntax. yeesh
ilaflott Oct 1, 2025
cec4dec
specify a different tempest-remap and see what happens
ilaflott Oct 1, 2025
18acb1b
another attempt at an env solve...
ilaflott Oct 1, 2025
57e1747
think i found i winning set of things
ilaflott Oct 1, 2025
49cd5e8
forget you, tempest-remap
ilaflott Oct 1, 2025
57901ab
remove test section at least, but put it all in host for now
ilaflott Oct 3, 2025
5131568
diffutils needed to squelch complaint
ilaflott Oct 3, 2025
34292de
remove some cruft from build.sh and divvy up run build reqs from host
ilaflott Oct 3, 2025
fd4a055
lets see what breaks when i remove the runtime reqs
ilaflott Oct 3, 2025
5e50dec
try this one instaead
ilaflott Oct 3, 2025
dcc7df7
probably want the gnu scientific libraries in host too
ilaflott Oct 3, 2025
7c6b0ff
put make in the testig requirement
ilaflott Oct 3, 2025
7ac4e67
Revert "put make in the testig requirement"
ilaflott Oct 3, 2025
906fd1c
Revert "probably want the gnu scientific libraries in host too"
ilaflott Oct 3, 2025
d9bd50e
Revert "try this one instaead"
ilaflott Oct 3, 2025
e7388f9
Revert "lets see what breaks when i remove the runtime reqs"
ilaflott Oct 3, 2025
1ebc028
Revert "remove some cruft from build.sh and divvy up run build reqs f…
ilaflott Oct 3, 2025
43482da
Revert "diffutils needed to squelch complaint"
ilaflott Oct 3, 2025
0379ad5
Revert "remove test section at least, but put it all in host for now"
ilaflott Oct 3, 2025
053c26b
wind it back... smaller edits. it seems like installing netcdf4 as a …
ilaflott Oct 3, 2025
21dab2c
make sure we are grabbing mpich builds
ilaflott Oct 3, 2025
32091de
what happens if i dont reconfigure in the testing step?
ilaflott Oct 3, 2025
4841a08
try moving a req or two around at a time...
ilaflott Oct 3, 2025
f63b510
Update test environment setup in meta.yaml
ilaflott Oct 3, 2025
0fbe216
Enhance Conda build workflow in GitHub Actions
ilaflott Oct 9, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
63 changes: 63 additions & 0 deletions .github/workflows/build_conda.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
name: build_conda

on: [push]

# pull_request:
# branches:
# - main

jobs:
build:
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
image: ['ghcr.io/noaa-gfdl/fre-cli:miniconda24_gcc14_v2', 'condaforge/miniforge3:latest']

container:
image: ${{ matrix.image }}

steps:
- name: Checkout Files
uses: actions/checkout@v4
with:
submodules: 'recursive'

- name: Run Conda to Build
continue-on-error: true
run: |
# append the reqd channels
conda config --append channels conda-forge
conda config --append channels noaa-gfdl

# remove any default channels
conda config --remove channels defaults || echo "no defaults to remove"

# just in case
conda config --show channels

## install conda-build and conda-verify
#conda install conda-build conda-verify
conda install conda-build

# conda build
mkdir -p /app/fre-nctools-tarball
conda build . --package-format tar.bz2 --output-folder /app/fre-nctools-tarball || echo "conda build failed, guarding. artifact upload will fail instead."
#conda build . --build-only --no-anaconda-upload --package-format tar.bz2 --output-folder /app/fre-nctools-tarball || echo "conda build failed, guarding. artifact upload will fail instead."
#conda build --test $(ls /app/fre-nctools-tarball/noarch/fre-nctools-*.tar.bz2)

# highly desired...
- name: Upload test-suite.log
uses: actions/upload-artifact@v4
with:
name: fre-nctools-test-suite-log
path: /app/fre-nctools-tarball/test-suite.log
# if-no-files-found: error

- name: Upload fre-nctools tarball
uses: actions/upload-artifact@v4
with:
name: fre-nctools-tarball
path: /app/fre-nctools-tarball/linux-64/fre-nctools-*.tar.bz2
if-no-files-found: error

42 changes: 0 additions & 42 deletions .github/workflows/distcheck.yml

This file was deleted.

42 changes: 0 additions & 42 deletions .github/workflows/main.yml

This file was deleted.

44 changes: 0 additions & 44 deletions .github/workflows/main_expensive.yml

This file was deleted.

41 changes: 0 additions & 41 deletions .github/workflows/release.yaml

This file was deleted.

29 changes: 0 additions & 29 deletions .github/workflows/tag.yaml

This file was deleted.

21 changes: 0 additions & 21 deletions .github/workflows/version.yml

This file was deleted.

Loading
Loading