New DATM CMIP7 CO2 file replacing earlier one that would fail after 6 month simulation

[slevis-lmwg]

New file has been generated: co2_input4MIPs_GHGConcentrations_CMIP_CR-CMIP-1-0-0_gm_1750-2022_CMIP7_c20260601.nc

• Tested to run successfully in a 1-yr simulation
• I have ./rimport-ed the file, so now need to replace the default in cdeps

Details about the file replacement appear in this CTSM issue: ESCOMP/CTSM#4072

PR that gets opened should close this and the CTSM issue.

[slevis-lmwg]

Regarding why the previous file may have been failing:
The failure happens after a historical simulation's first 6 months (June 30 1850) and looks like a time-related ESMF error. The failing file has valid time_bnds, while the working file has time_bnds set to missing value. As such, the current hypothesis is that valid time_bnds may cause the failure. Oh, and changing the align from 1850 to 1 makes the failing file work, except this way the CO2 is missaligned.

The failing file also does not specify lat/lon, while the working file does. This seems unrelated based on the error.

Error in cesm.log:

dec2136.hsn.de.hpc.ucar.edu 2: (shr_tInterp_getFactors)  ERROR illegal linear times:  18500616        0      101 
(shr_tInterp_getFactors) (^@^@ 18500716    43200
dec2136.hsn.de.hpc.ucar.edu 2:  (shr_tInterp_getFactors)  illegal itimes
dec2136.hsn.de.hpc.ucar.edu 2:  ESMF_Finalize: Error closing trace stream
dec2136.hsn.de.hpc.ucar.edu 2: MPICH ERROR [Rank 2] [job id 38c6c33b-ffb2-48d9-b25e-87ec5ecd61fc] [Mon Jun  1 15:17:06 2026] [dec2136] - Abort(1) (rank 2 in comm 496): application called MPI_Abort(comm=0x84000001, 1) - process 2
dec2136.hsn.de.hpc.ucar.edu 2: forrtl: severe (174): SIGSEGV, segmentation fault occurred
dec2136.hsn.de.hpc.ucar.edu 2: Image              PC                Routine            Line        Source
dec2136.hsn.de.hpc.ucar.edu 2: libc.so.6          0000151559DEB900  Unknown               Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libmpi_intel.so.1  000015155BE86161  Unknown               Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libmpi_intel.so.1  000015155BE86538  Unknown               Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libmpi_intel.so.1  000015155BC3C9DD  Unknown               Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libmpi_intel.so.1  000015155A5CC408  MPI_Abort             Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libesmf.so         00001515642DABEF  _ZN5ESMCI3VMK5abo     Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libesmf.so         00001515642D82C4  _ZN5ESMCI2VM5abor     Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libesmf.so         00001515642F84D8  c_esmc_vmabort_       Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libesmf.so         0000151564998497  esmf_vmmod_mp_esm     Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: libesmf.so         00001515648163C4  esmf_initmod_mp_e     Unknown  Unknown
dec2136.hsn.de.hpc.ucar.edu 2: cesm.exe           000000000042ACD8  esmapp                    145  esmApp.F90

and PET000.ESMF_LogFile:

20260601 170549.765 ERROR            PET000 (shr_stream_verifyTCoord) ERROR: elapsed seconds must be increasing
20260601 170550.038 INFO             PET000  Finalizing ESMF with endflag==ESMF_END_ABORT
20260601 170550.039 ERROR            PET000 /glade/derecho/scratch/csgteam/temp/spack/derecho/25.10/builds/spack-stage-esmf-8.9.1-uh766lmd2aaohkmvlulh74myqi44bynx/spack-src/src/Infrastructure/Trace/src/ESMCI_Trace.C:1861 ESMCI::TraceEventRegionExit() Wrong argument specified  - Trace regions not properly nested exiting from region: [ESMF] Expected exit from: datm_readLBUB_fbound
20260601 170550.039 ERROR            PET000 /glade/derecho/scratch/csgteam/temp/spack/derecho/25.10/builds/spack-stage-esmf-8.9.1-uh766lmd2aaohkmvlulh74myqi44bynx/spack-src/src/Infrastructure/Trace/src/ESMCI_Trace.C:1296 ESMCI::TraceClose() Wrong argument specified  - Internal subroutine call returned Error
20260601 170550.039 ERROR            PET000 ESMF_Trace.F90:119 ESMF_TraceClose() Wrong argument specified  - Internal subroutine call returned Error