Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generated new surface data including soil order for Phosphorus Cycle. #268

Merged
merged 1 commit into from
Jul 17, 2015

Conversation

acme-y9s
Copy link
Contributor

@acme-y9s acme-y9s commented Jul 9, 2015

Modified the surface data tool source code files and clm namelist files to add the soil order into the surface data file, which is needed for scientific development of P Cycle.

CC

@bishtgautam
Copy link
Contributor

  • I would suggest reverting the changes made in the models/lnd/clm/tools/clm4_5/mksurfdata_map/src/Makefile.common.
  • By the change of CSMDATA in models/lnd/clm/tools/clm4_5/mksurfdata_map/mksurfdata.pl, we are implicitly assuming that Titan would be the default machine on which ACME datasets would be generated. Are folks (@rljacob, @mt5555, others) ok with this change and should we document this somewhere on confluence?

@thorntonpe
Copy link
Contributor

Since there are small differences in the files depending on machine, I think it makes sense to designate a single machine to make all the files, using the ACME code.

From: Gautam Bisht [mailto:notifications@github.com]
Sent: Thursday, July 09, 2015 6:09 PM
To: ACME-Climate/ACME
Subject: Re: [ACME] Generated new surface data including soil order for Phosphorus Cycle. (#268)

· I would suggest reverting the changes made in the models/lnd/clm/tools/clm4_5/mksurfdata_map/src/Makefile.common.
· By the change of CSMDATA in models/lnd/clm/tools/clm4_5/mksurfdata_map/mksurfdata.pl, we are implicitly assuming that Titan would be the default machine on which ACME datasets would be generated. Are folks (@rljacobhttps://github.com/rljacob, @mt5555https://github.com/mt5555, others) ok with this change and should we document this somewhere on confluence?


Reply to this email directly or view it on GitHubhttps://github.com//pull/268#issuecomment-120162286.

@bbye
Copy link
Contributor

bbye commented Jul 10, 2015

How does that work for folks who need to modify the surface datasets but don't have access to Titan?

@bishtgautam
Copy link
Contributor

@bbye : I would recommend applying for an account on Titan. On the Computational Resources page, you can search for OLCF Account Request Form. Though, presently the LCF project id is listed as TBD for 2015/07-2016/06, but I believe it is cli112 (same as last year).

daliwang added a commit that referenced this pull request Jul 13, 2015
* acme-y9s/surfdata_map:
  Generated new surface data including soil order for Phosphorus Cycle.
@bishtgautam
Copy link
Contributor

@daliwang : The changes in Makefile.common have fixed a value of USER_FC, thereby not allowing the user to override the Fortran compiler. Are you sure we want that?

@acme-y9s
Copy link
Contributor Author

@bishtgautam : I made the changes several months ago, but I still can remember If we do not give a value for USER_FC, we will fail to compile the code and generate the executable file on Titan. So, at the beginning of this file I mentioned that the changes just made for Titan. The user still can change the value USER_FC for other machine. I did not quit understand what you really mean ? We should not specify the value for USER_FC?

@bishtgautam
Copy link
Contributor

@acme-y9s : USER_FC ------ Allow user to override the default Fortran compiler specified in Makefile. But, presently USER_FC is hard-coded to be pgf90 for all machines (not just for Titan), thereby defeating the purpose of it.

You have correctly pointed out in your comment at the beginning of the Makefile.common

# set up for titan
#setenv LIB_NETCDF /opt/cray/netcdf/4.3.2/PGI/141/lib
#setenv INC_NETCDF /opt/cray/netcdf/4.3.2/PGI/141/include
#setenv USER_FC pgf90
# end for titan

A user needs to set appropriate value for USER_FC, LIB_NETCDF and INC_NETCDF as environment variables for the script to work correctly and in the case of Titan, the above mentioned values are correct. But, there is no need for harding-coding those values within the Makefile.common.

Modified the surface data tool source code files and clm namelist files to add the soil order into the surface data file, which is needed for scientific development of P Cycle.

CC
@acme-y9s acme-y9s force-pushed the acme-y9s/surfdata_map branch from 53b20cb to 1bdd176 Compare July 14, 2015 20:08
@daliwang
Copy link
Contributor

I got a problem to merge local "acme-y9s/surfdata_map" into my local "next" (after git reset --hard origin/next), error message below, any suggestion?

Auto-merging models/atm/cam/src/physics/cam/phys_control.F90
CONFLICT (content): Merge conflict in models/atm/cam/src/physics/cam/phys_control.F90
Automatic merge failed; fix conflicts and then commit the result.

@jgfouca
Copy link
Member

jgfouca commented Jul 15, 2015

Dali, this is fine, it just means that your branch and some branch that was merged into next touched the same lines of code. This will happen from time to time. You need to open the conflicting file and look for the following:

>>>>
*your_changes*
========
*their_changes*
<<<<

You need to look at the difference between yours and theirs and hopefully it will be obvious what the resolution would be. Once you're satisfied, run "git add models/atm/cam/src/physics/cam/phys_control.F90" then "git commit".

@mt5555
Copy link
Contributor

mt5555 commented Jul 15, 2015

And just to repeat Jim's point in a different way: Please dont simply through away "their changes" and put in "your changes". You probably will have to take a merger of code from both sections.

@bishtgautam
Copy link
Contributor

models/atm/cam/src/physics/cam/phys_control.F90 is different in master and next.

145c145
<       liqcf_fix, regen_fix, demott_ice_nuc, &                                               
---
>       liqcf_fix, regen_fix, demott_ice_nuc, &
323c323
<                         do_clubb_sgs_out, do_tms_out, state_debug_checks_out, fix_g1_err_ndrop_out,     & !BSINGH - bugfix for ndrop.F90
---
>                         do_clubb_sgs_out, do_tms_out, state_debug_checks_out, fix_g1_err_ndrop_out,     &
406c406
<    if ( present(fix_g1_err_ndrop_out    ) ) fix_g1_err_ndrop_out     = fix_g1_err_ndrop 
---
>    if ( present(fix_g1_err_ndrop_out    ) ) fix_g1_err_ndrop_out     = fix_g1_err_ndrop
411c411
<    if ( present(convproc_method_activate_out))convproc_method_activate_out= convproc_method_activate 
---
>    if ( present(convproc_method_activate_out))convproc_method_activate_out= convproc_method_activate

Everyone starting a new branch from current head of master will have a similar conflict when they try to merge in next. Thus, phys_control.F90 in next should be updated.

@mt5555
Copy link
Contributor

mt5555 commented Jul 15, 2015

I think we need a merge of "master" into "next"

@bishtgautam
Copy link
Contributor

I think we can create a new branch (dev-name/cam/phys-control-conflict-fix) starting from master. Merge dev-name/cam/phys-control-conflict-fixinto next. Finally, merge dev-name/cam/phys-control-conflict-fix into master.

At the end, one could rebase acme-y9s/surfdata_map branch from master and there should be no conflicts when merging this PR into next.

@jgfouca
Copy link
Member

jgfouca commented Jul 15, 2015

That's odd, most of those lines look identical on both branches. Is there a whitespace change? In any event, very easy conflicts to resolve.

@bishtgautam
Copy link
Contributor

On second thought, Mark's suggestion of merging master into next is much simpler.

@daliwang
Copy link
Contributor

I followed @jgfouca comments and have added models/atm/cam/src/physics/cam/phys_control.F90 into the merge. Since the acme-y9s/surfdata_map branch was originally branched from master, so we should solve the file difference (phys_control.F90) between master and next.

daliwang added a commit that referenced this pull request Jul 16, 2015
* acme-y9s/surfdata_map:
  Generated new surface data including soil order for Phosphorus Cycle.

Conflicts:
	models/atm/cam/src/physics/cam/phys_control.F90
@daliwang
Copy link
Contributor

This branch has been merged into next. The missing new input parameter file is now in ACME data svn repo. We kept the makefile.common unchanged and added a new makefile example Makefile.titan.

@daliwang daliwang merged commit 1bdd176 into master Jul 17, 2015
daliwang added a commit that referenced this pull request Jul 17, 2015
* acme-y9s/surfdata_map:
  Generated new surface data including soil order for Phosphorus Cycle.
@daliwang daliwang deleted the acme-y9s/surfdata_map branch July 17, 2015 14:29
@daliwang daliwang restored the acme-y9s/surfdata_map branch July 17, 2015 17:44
daliwang added a commit that referenced this pull request Jul 17, 2015
daliwang added a commit that referenced this pull request Jul 17, 2015
This reverts commit 349a2bd, reversing
changes made to a7a3e4b.
@daliwang
Copy link
Contributor

@jgfouca and @jedbrown New question:

I repeated the merge tonight.

  1. git branch acme-y9s/surfdata_map --track origin/acme-y9s/surfdata_map
  2. git checkout next
  3. git reset --hard origin/next
  4. git merge --no-ff acme-y9s/surfdata_map

GIT merge did not complain file conflict anymore, but showed "Already up-to-date". However

git diff acme-y9s/surfdata_map:models/atm/cam/src/physics/cam/phys_control.F90 next: models/atm/cam/src/physics/cam/phys_control.F90

still shows the differences between two files. Any guidance? Thanks.

@bishtgautam
Copy link
Contributor

I believe you need to 'revert the revert'. See the last section on https://git-scm.com/blog/2010/03/02/undoing-merges.html

@bishtgautam
Copy link
Contributor

argh ... 'reverting the revert' will end by in a models/atm/cam/src/physics/cam/phys_control.F90 that can't be compiled.

@daliwang
Copy link
Contributor

I just want to push the acme-y9s in a right way. Can I just push my next into origin/next this time?

@douglasjacobsen
Copy link
Member

@daliwang No, you can't do that. Tomorrow morning when I get time I'll lay out some instructions on how to fix this.

@daliwang
Copy link
Contributor

@jgfouca Thanks for this. I will wait and follow your instructions tomorrow.

Also for your information, I have also tried

  1. git branch acme-y9s/surfdata_map-resolved --track origin/acme-y9s/surfdata_map
  2. git checkout next
  3. git reset --hard origin/next
  4. git merge --no-ff acme-y9s/surfdata_map-resolved

I found out the acme-y9s/surfdata_map-resolved:models/atm/cam/src/physics/cam/phys_control.F90 is same with the one in origin/next now, but is different than master:models/atm/cam/src/physics/cam/phys_control.F90.

@douglasjacobsen
Copy link
Member

@daliwang I'm going to add instructions to the "Help: Testing" confluence page, just so more people will likely see it in the future.

@daliwang
Copy link
Contributor

@jgfouca Thanks. There is another PR related to Phosphorus Cycle which will involve many file conflicts. I will work with you careful on this.

@jgfouca
Copy link
Member

jgfouca commented Jul 20, 2015

@bishtgautam , reverting the revert is the right way. The commit can then be amended to fix the broken code.

daliwang added a commit that referenced this pull request Jul 22, 2015
daliwang added a commit that referenced this pull request Jul 27, 2015
jgfouca added a commit that referenced this pull request Jul 27, 2015
Validation enhancements to update_acme_tests

* Added find_all_supported_platforms() to update_acme_tests.py
  module. This function returns all (machine, compiler, mpilib) combos
  found in config_machines.xml.
* Added a --verbose option to update_acme_tests script.
* Updated update_acme_tests to prune all unsupported platforms,
  reporting each pruned entry if --verbose flag is passed.
* Executed on testlist.xml, removing unsupported platforms.

Fixes #284.

SEG-118

[BFB]

* jnjohnsonlbl/compiler_check_for_tests:
  Validation enhancements to update_acme_tests:
  Revert "Revert "Merge branch 'acme-y9s/surfdata_map'  (PR #268)""
jgfouca added a commit that referenced this pull request Jul 27, 2015
…285)

Validation enhancements to update_acme_tests

* Added find_all_supported_platforms() to update_acme_tests.py
  module. This function returns all (machine, compiler, mpilib) combos
  found in config_machines.xml.
* Added a --verbose option to update_acme_tests script.
* Updated update_acme_tests to prune all unsupported platforms,
  reporting each pruned entry if --verbose flag is passed.
* Executed on testlist.xml, removing unsupported platforms.

Fixes #284.

SEG-118

[BFB]

* jnjohnsonlbl/compiler_check_for_tests:
  Validation enhancements to update_acme_tests:
  Revert "Revert "Merge branch 'acme-y9s/surfdata_map'  (PR #268)""
rljacob added a commit that referenced this pull request Jul 20, 2016
92a5d03 Merge pull request #271 from jedwards4b/misc_python_fixes
8659568 fix issues with code_checker and missed run_cmd changes
1f9f0b3 Merge branch 'jedwards4b-more_mira_port'
1df3edd add path search for pylint
89c084f change CAM55 to CAM60
03520b1 merge to trunk
367d47f Merge branch 'jgfouca/add_code_checking' (PR #267)
de33082 Fix a couple remaining pylint issues
1516c3b Made code_checker parallel, fix test name so it actually runs
e46d0f4 Merge branch 'testreporter'
0c091cc remove whitespace
8a25823 Merge branch 'testreporter_update' of https://github.com/fischer-ncar/cime into testreporter
54e3916 Fix remaining test failures
e777c55 Update testreporter to handle the new ESMCI TestStatus files. Put back ETEST compset needed for testing.
300cdce Merge pull request #268 from jedwards4b/pbs_fixes
84ebf2d remove commented code
037d253 get st_archive working on mira
aa193c7 need compiler attribute in get_default_mpilib
30b5fcf remove colon from fixes line
42ad9e0 add SAVE_TIMING_DIR for blues
b36e2cd Bug fix
380f8d4 fix regex match for blues
c5d157e rework CIMEROOT capture in templates
acb6008 sta working now
77b4ae1 more updates for mira
b90daa8 changed so that the expression is evald
a0c984d update acme side
8a5ef7f correct batch directives
bfac10e get mira working again
706c28e Merge branch 'master' of https://github.com/ESMCI/cime
9a4db4d Merge pull request #261 from jedwards4b/nck_fix
4fff865 All scripts passing
553bba5 fixes for pbs systems
479ddea Fix missing import, dunno how this made it past testing
557cff3 Merge branch 'master' of https://github.com/ESMCI/cime
ed3a74d Merge branch 'jgfouca/python3_better_error' merge to master
fd7dd06 fix merge conflict
c233f96 Add code checker test. Remove refactor disablings from scripts_regression_tests.py
c23bb0b Progress. Tool added. build.py 100%
ca97ca9 fix user mod support for multi instance
17fe594 got nck build right
d9b7302 correct problems in nck test
e681111 better fix for nck test issues
1abee3e if ntasks for a comp is 1 the ninst should not be > 1
8b6d137 Merge branch 'jgfouca/fix_acme_postbuild' (PR #259)
fb3aeea Fix unit tests. Unsafe defaults were being used
9239984 Suffix all files with lid
d4c503b Minor improvement to error message
f70029d Python3 users should get a better error now
d3de6ae Trying to get reasonable error when using python 3
e3dcd0b Minor fix
bbf9ba7 Merge pull request #260 from mvertens/remove_esmf_interface
302c66c Port performance archiving scripts to python.
766f974 Merge branch 'remove_esmf' into remove_esmf_interface
5e13ecd removed NOC test
42d19e7 fixes for pre-alpha cesm tests
e989229 Removed all code related to using the ESMF interfaces in driver_cpl directory
83e7e0f removed esmf interfaces
8fa604a Merge branch 'jedwards4b-read_xml_fix'
41c71bf updated to PR #255
c10289e Merge pull request #252 from ESMCI/santos/case-context-manager
77e5a78 needed a flush in systems_tests_common
215987a Add `read_only` flag to `Case` constructor.
d7ae79b Add read-only mode to `Case` objects.
f84aebb Make `Case` a context manager.
0f298cf Merge branch 'master' of https://github.com/ESMCI/cime
c52b65c Merge pull request #251 from jedwards4b/test_updates2
cd50e4f Merge remote-tracking branch 'mydev/test_updates2'
87b9b7d add sanity check
f684eaf added new version of seq_diag_mct.F90 and backed out new config_grids.xml schema
dea5064 move case update to preview_namelist
d1ed95a fixes erp test
e0dda70 working on erp
4c4a57f a pythonization of the original csh scripts
f9c8252 fixed bugs in erp.py - there are still outstanding problems
dabbdce new schema (version 2.0) for config_grids.xml
3f5eca9 Merge remote-tracking branch 'origin/master' into test_updates2
d55ba8f fixed problems with order dependence of compset attributes
ad26223 reordered elements such that grid search could be done correctly
3874918 merged to cesmdev cime cime4.5.22
a26d382 added comments to seq.py
a65a6f3  added file back in - needed for regression tests
dbde0f0 xmlchange_cmds was not called correctly - this is now fixed
ec6f656 fixes to get tests working and major cleanup of utils/perl
a1cbd50 updates for numerous tests and deletion from Testing/TestCases
e20a53b added pem and erp tests
8e424dc fixed removal of CME tests
8b32dc3 Merge pull request #471 from fischer-ncar/Replace_Bcompsets
f3dc375 Fix broken compset names
9bea53a Merge isotope updates and corip1 module updates
ceac486 Merge pull request #469 from fischer-ncar/corip1_update
26918a5 Update modules for corip1
60d2fa5 Merge isotope updates to corip1_update
81102e9 Merge pull request #463 from cacraigucar/geotrace_cime
d9a31c0 Merge tag 'cime4.5.20' into geotrace_cime
b08f005 Merge remote-tracking branch 'upstream/master'
e8d85ba Merge pull request #462 from fischer-ncar/mpas_o
3c9357d Merge updated origin.
10bc4ac Update ChangeLog
9be64db Merge pull request #467 from fischer-ncar/ChangeLog
8d45e7e Update ChangeLog
ae57982 Merge remote-tracking branch 'upstream/master'
27a22d1 Merge pull request #465 from fischer-ncar/ChangeLog
baec797 Add new ocn ice coupler fields
f17545b Merge pull request #459 from apcraig/marbl
de371db Update to add WaveWatch support
467b8ea Merge pull request #464 from fischer-ncar/WaveWatch
15b3bea Update ChangeLog, fix typo in config_compset.xml
3767ae8 Removed allactive compsets that weren't being tested.
49b2b47 Updates for WaveWatch
bc93250 Changes to config_files.xml and config_grids.xml to add mpas-o
43d5d0e Merge tag 'cime4.5.17' into geotrace_cime
9e2603e Merge tag 'cime4.5.14' into geotrace_cime
1837319 Merge tag 'cime4.5.10.1' into geotrace_cime
1c8ef5b Merge tag 'cime4.5.6' into geotrace_cime
a9a5ac9 Merge tag 'cime4.4.9' into geotrace_cime
7e4143e Add bcphi, bcpho, flxdst ice to ocean coupling fields
c4a9548 Remove ESMF tests and add ChangeLog
bc5524e git reset --hard geotrace_cime_n13_cime4.4.8 and add aux_isotope test
9eae658 update esp_present bug for cime4.5.10.1
eba705a Merge tag 'geotrace_cime_n12_cime4.4.8' into geotrace_cime
43e18b8 [ 50 character, one line summary ] add Mariana's fix for CO2 for Isotopes
dd34c44 Fix esp assignment in seq_rest_mod.F90.  This will go into cesm1_5_beta6.1
a4be399 Merge tag 'cime4.4.8' into geotrace_cime
4410a89 Revert "Revert "Merge tag 'cime4.4.7' into geotrace_cime""
f76d977 Revert "Merge tag 'cime4.4.7' into geotrace_cime"
c8f9137 Merge tag 'cime4.4.7' into geotrace_cime
d5df824 Merge remote-tracking branch 'upstream/master'
e598bea Merge tag 'cime4.2.3' into geotrace_cime
cd5c2c9 Merge tag 'cime4.0.3' into geotrace_cime
502959b Merge tag 'cime3.0.7' into geotrace_cime
a552bff Merge tag 'cime2.0.18-p1.1' into geotrace_cime
1fafc89 Merge tag 'cime2.0.0' into geotrace_cime
0f0ff2b Add -ntr_iso to CICE config for isotopes
ea874e9 Put in correct CMakeLists.txt
e96f3b2 Merge tag 'cime1.1.10' into geotrace_cime
3d72660  	modified:   driver_cpl/bld/namelist_files/namelist_definition_drv.xml  	new file:   driver_cpl/driver/mrg_mod.F90  	modified:   driver_cpl/driver/prep_ice_mod.F90  	modified:   driver_cpl/driver/prep_ocn_mod.F90  	modified:   driver_cpl/driver/prep_rof_mod.F90  	modified:   driver_cpl/driver/seq_diag_mct.F90  	modified:   driver_cpl/driver/seq_flux_mct.F90  	modified:   driver_cpl/shr/seq_flds_mod.F90  	modified:   externals/pio/CMakeLists.txt  	modified:   machines/config_pes.xml  	modified:   scripts/Tools/config_compsets.xml  	modified:   scripts/Tools/config_definition.xml  	modified:   share/csm_share/shr/shr_const_mod.F90  	modified:   share/csm_share/shr/shr_flux_mod.F90  	new file:   share/csm_share/shr/water_isotopes.F90  	new file:   share/csm_share/shr/water_types.F90                       - rest of files from geotracer svn branch
99e4eeb 	modified:   driver_cpl/bld/build-namelist                 - added first file for geotrace branch
32b1b7d Merge tag 'cime2.0.17-p1.1' into cime2.0.18-p1
cebd23c patch to fix resubmit in cesm1_3_beta07

git-subtree-dir: cime
git-subtree-split: 92a5d03
@rljacob rljacob deleted the acme-y9s/surfdata_map branch April 26, 2017 17:36
yunpengshan2014 pushed a commit that referenced this pull request Apr 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants