Skip to content

Add a payu init script to auto-generate updated diag_table after payu…#86

Open
minghangli-uni wants to merge 3 commits intomainfrom
85-payu-init-diag_table-generation
Open

Add a payu init script to auto-generate updated diag_table after payu…#86
minghangli-uni wants to merge 3 commits intomainfrom
85-payu-init-diag_table-generation

Conversation

@minghangli-uni
Copy link
Collaborator

closes #85

This PR introduces a Payu init script that automates running make_diag_table.py when using the experiment generator and experiment runner workflow.

With this change, users no longer need to manually execute:

python3 make_diag_table.py

after creating branches.

This is Intended primarily for testing and development, not for production runs.

@minghangli-uni minghangli-uni self-assigned this Sep 21, 2025
@minghangli-uni
Copy link
Collaborator Author

minghangli-uni commented Feb 26, 2026

Not for production use - just a helper for testing diagnostic changes using experiment-generator/runner. Would anyone mind reviewing it? @ACCESS-NRI/ocean @aekiss ?

EDIT: Apologies - this is quite an old PR and doesnt include the recent config updates. I'll update it and ping again for another review.

@minghangli-uni minghangli-uni requested review from a team and aekiss February 26, 2026 23:16

case $MODEL in
access-om3)
DEST="diagnostic_profiles/source_yaml_files/make_diag_table"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is done in 1c96cd1

cd $BASE
echo "-- Cloned make_diag_table repo to $DEST"

if [ $MODEL = "access-om2" ]; then
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

or access-om3 - see ACCESS-NRI/access-om3-configs#959

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in b2c9bb1

mkdir -p $BASE

rm -rf $DEST
git clone https://github.com/COSIMA/make_diag_table $DEST
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this will update to whatever is the latest, which breaks provenance - would be better to have make_diag_table as a submodule

Copy link
Contributor

@aekiss aekiss left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure why you'd want to do it this way. It would be neater and have proper provenance to include make_diag_table as a git submodule

@aekiss
Copy link
Contributor

aekiss commented Feb 27, 2026

or use /g/data/vk83/apps/make_diag_table/make_diag_table.py, though that won't retain provenance of what version of make_diag_table was used

@dougiesquire
Copy link
Collaborator

I think we want to add make_diag_table as a dependency of Payu and do this from the Payu driver

@minghangli-uni
Copy link
Collaborator Author

I think we want to add make_diag_table as a dependency of Payu and do this from the Payu driver

I remember this being discussed a while ago and we were seeking approval from @aekiss on making make_diag_table a Payu dependency. It's good that this PR has brought the topic back up.

@minghangli-uni minghangli-uni force-pushed the 85-payu-init-diag_table-generation branch from 62669f3 to b2c9bb1 Compare February 27, 2026 02:15
@aekiss
Copy link
Contributor

aekiss commented Feb 27, 2026

I'm happy for payu to depend on make_diag_table, but it sounds more like something @aidanheerdegen or team would be better positioned to approve

@aidanheerdegen
Copy link
Member

I APPROVE!

@dougiesquire
Copy link
Collaborator

@aekiss are you okay with me moving make_diag_table.py into the ACCESS-NRI Github org?

@aekiss
Copy link
Contributor

aekiss commented Mar 2, 2026

I suppose, if it's actually necessary

@dougiesquire
Copy link
Collaborator

Necessary, no. Though if we are going to deploy to our conda channel it does make things a little cleaner.

We'll likely move to yaml file support in FMS with the next ACCESS-OM3 release and this may change how we want to handle these files anyway. So let's just leave in the COSIMA org for now and I'll only just the ability to install with pip.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Payu init script for diag_table generation

4 participants