MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.01-35-ge3b1468b8f16) initialized Starting run at 07:31:28 UTC on 2022-01-21. Successfully read inputs file ... Castro git describe: 21.12-27-g958e0cc7a AMReX git describe: 22.01-35-ge3b1468b8 Microphysics git describe: 22.01-20-g1a290c72 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017141033 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.073782468 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00771237 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.269788474 Castro::do_new_sources() time = 0.009474616 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7240442114 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.371158485 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007297563 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.259206261 Castro::do_new_sources() time = 0.00879521 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7684691084 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.354999821 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005916371 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.253599047 Castro::do_new_sources() time = 0.008363495 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7872689235 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.344989892 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005767141 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.229087363 Castro::do_new_sources() time = 0.009083177 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8659562782 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.311679359 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006056959 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.165918094 Castro::do_new_sources() time = 0.009599773 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.118619616 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.242627988 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.016996858 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008026796 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.169918582 Castro::do_new_sources() time = 0.00900802 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.121466112 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.240766475 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003932369 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.156004572 Castro::do_new_sources() time = 0.006187697 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.282198256 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.212066608 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003949968 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.155831519 Castro::do_new_sources() time = 0.00503735 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.31783411 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.206252202 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004101363 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.154956062 Castro::do_new_sources() time = 0.005096437 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.323115983 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.205409636 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003929833 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.155410698 Castro::do_new_sources() time = 0.005087791 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.317217081 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.206207774 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.014762816 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.123030703 seconds Ending run at 07:31:31 UTC on 2022-01-21. Run time = 2.983490402 Run time without initialization = 2.851691653 Average number of zones advanced per microsecond: 0.919 Average number of zones advanced per microsecond per rank: 0.057 TinyProfiler total time across processes [min...avg...max]: 2.983 ... 2.983 ... 2.984 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5425 1.8262 1.9848 66.52% MultiFab::min() 10 0.0004005 0.1568 0.4587 15.38% Amr::writePlotFile() 2 0.1783 0.1848 0.1864 6.25% FabArray::ParallelCopy_finish() 251 0.04865 0.08035 0.1311 4.39% FabArray::setVal() 160 0.07864 0.08676 0.09294 3.12% Castro::reset_internal_energy() 63 0.05419 0.06047 0.06822 2.29% VisMF::Write(FabArray) 11 0.04393 0.04873 0.06107 2.05% StateData::FillBoundary(geom) 20 0.02343 0.03451 0.05618 1.88% FabArray::ParallelCopy_nowait() 251 0.03249 0.04262 0.05593 1.87% Castro::estTimeStep() 21 0.0177 0.03102 0.0539 1.81% Castro::do_old_sources() 10 0.0001504 0.01176 0.05112 1.71% Castro::post_timestep() 10 0.007426 0.01622 0.04197 1.41% FillPatchIterator::Initialize 251 0.03214 0.03738 0.04148 1.39% Castro::computeTemp() 63 0.03315 0.03725 0.04147 1.39% Castro::do_advance_ctu() 10 0.02244 0.02986 0.03442 1.15% Castro::expand_state() 10 0.01703 0.0246 0.0306 1.03% Castro::finalize_do_advance() 10 0.002045 0.02427 0.02927 0.98% Castro::initialize_do_advance() 10 0.01637 0.02581 0.0286 0.96% Castro::normalize_species() 62 0.01919 0.02225 0.02544 0.85% Castro::do_new_sources() 10 0.000118 0.006373 0.02463 0.83% Castro::construct_new_gravity_source() 10 0.02011 0.02222 0.02423 0.81% Castro::initialize_advance() 10 0.01553 0.01861 0.02299 0.77% Castro::hybrid_to_linear_momentum() 62 0.01644 0.01954 0.02291 0.77% Amr::checkPoint() 3 0.007976 0.01425 0.01756 0.59% MultiFab::Saxpy() 20 0.01258 0.01443 0.01661 0.56% MultiFab::contains_nan() 20 0.01001 0.01278 0.01619 0.54% FabArray::setDomainBndry() 251 0.007441 0.009661 0.01215 0.41% Gravity::get_new_grav_vector() 11 0.007057 0.009092 0.01132 0.38% Castro::derive() 187 0.008078 0.009803 0.01103 0.37% Castro::construct_old_gravity_source() 10 0.005736 0.008386 0.01047 0.35% Gravity::add_pointmass_to_gravity() 21 0.008163 0.009036 0.01015 0.34% Amr::defBaseLevel() 1 0.004611 0.006686 0.008483 0.28% Castro::fill_hybrid_hydro_source() 30 0.005044 0.006348 0.0072 0.24% Gravity::get_old_grav_vector() 10 0.004934 0.005671 0.00661 0.22% Castro::volWgtSum() 176 0.005234 0.005631 0.005916 0.20% Castro::enforce_min_density() 62 0.004206 0.004842 0.005699 0.19% StateData::define() 4 0.003352 0.004581 0.005108 0.17% Castro::post_init() 1 0.0005955 0.001208 0.004933 0.17% Castro::swap_state_time_levels() 10 0.004038 0.00439 0.004749 0.16% Castro::initData() 1 0.001713 0.002542 0.00302 0.10% main() 1 0.000992 0.0012 0.001553 0.05% Castro::subcycle_advance_ctu() 10 5.592e-05 0.0001287 0.001045 0.04% Amr::InitAmr() 1 0.0002746 0.0004092 0.0006245 0.02% Castro::locSquaredSum() 11 0.0004025 0.0004839 0.0005877 0.02% Amr::coarseTimeStep() 10 0.0003223 0.0004116 0.0005451 0.02% DistributionMapping::LeastUsedCPUs() 1 1.321e-05 0.000262 0.0004203 0.01% Castro::clean_state() 62 0.0001889 0.0002574 0.000317 0.01% StateData::checkPoint() 12 2.301e-05 4.626e-05 0.0003073 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002176 0.0002488 0.0002766 0.01% StateDataPhysBCFunct::() 251 0.0001757 0.0002204 0.0002616 0.01% FabArray::ParallelCopy() 251 0.0001581 0.0001862 0.0002266 0.01% FillPatchSingleLevel 251 0.0001543 0.0001878 0.0002181 0.01% Castro::enforce_consistent_e() 1 6.496e-05 9.998e-05 0.0001734 0.01% AmrLevel::checkPoint() 3 5.632e-05 7.399e-05 0.0001598 0.01% Castro::finalize_advance() 10 8.829e-05 0.00013 0.0001592 0.01% Castro::computeNewDt() 9 7.267e-06 1.779e-05 0.0001497 0.01% Castro::construct_new_source() 70 8.286e-05 0.0001184 0.0001429 0.00% Castro::construct_old_source() 70 6.081e-05 8.953e-05 0.0001204 0.00% Castro::construct_new_gravity() 10 4.981e-05 7.261e-05 0.0001172 0.00% Amr::timeStep() 10 5.403e-05 6.856e-05 0.0001095 0.00% Castro::construct_old_gravity() 10 5.726e-05 8.114e-05 0.0001082 0.00% Amr::writeSmallPlotFile() 1 3.609e-05 6.617e-05 0.0001033 0.00% Castro::advance() 10 4.575e-05 6.032e-05 8.876e-05 0.00% FabArrayBase::CPC::define() 2 3.044e-05 5.93e-05 8.388e-05 0.00% Castro::apply_source_to_state() 20 4.3e-05 6.065e-05 7.559e-05 0.00% Castro::check_for_nan() 20 3.058e-05 4.585e-05 6.538e-05 0.00% Castro::enforce_speed_limit() 62 3.855e-05 5.014e-05 6.373e-05 0.00% FabArrayBase::getCPC() 20 4.285e-05 4.972e-05 5.992e-05 0.00% Castro::construct_new_hybrid_source() 10 1.935e-05 3.056e-05 5.167e-05 0.00% Amr::FinalizeInit() 1 5.176e-06 1.005e-05 5.016e-05 0.00% Gravity::swapTimeLevels() 10 1.652e-05 2.351e-05 3.182e-05 0.00% Castro::create_source_corrector() 10 1.189e-05 2.08e-05 2.99e-05 0.00% Castro::construct_old_hybrid_source() 10 1.573e-05 2.165e-05 2.7e-05 0.00% Castro::gwstrain() 11 6.685e-06 9.376e-06 1.915e-05 0.00% Amr::initSubcycle() 1 9.498e-06 1.415e-05 1.745e-05 0.00% AmrLevel::AmrLevel(dm) 1 8.495e-06 1.314e-05 1.739e-05 0.00% Castro::construct_new_rotation_source() 10 8.881e-06 1.244e-05 1.537e-05 0.00% Castro::construct_old_rotation_source() 10 5.726e-06 9.095e-06 1.269e-05 0.00% Castro::retry_advance_ctu() 10 6.683e-06 8.836e-06 1.116e-05 0.00% Amr::InitializeInit() 1 2.783e-06 4.016e-06 1.037e-05 0.00% Castro::FluxRegFineAdd() 10 6.445e-06 8.45e-06 1.009e-05 0.00% Gravity::set_mass_offset() 10 5.853e-06 7.361e-06 9.384e-06 0.00% AmrLevel::checkPointPre() 3 3.023e-06 4.392e-06 9.007e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.001e-06 6.471e-06 8.346e-06 0.00% Castro::computeInitialDt() 2 2.921e-06 4.956e-06 7.736e-06 0.00% AmrLevel::checkPointPost() 3 4.346e-06 5.642e-06 7.402e-06 0.00% Amr::initialInit() 1 1.732e-06 2.698e-06 4.972e-06 0.00% Castro::post_regrid() 1 2.643e-06 4.043e-06 4.667e-06 0.00% Amr::init() 1 3.232e-06 3.74e-06 4.285e-06 0.00% DistributionMapping::Distribute() 1 1.461e-06 2.017e-06 2.643e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 2.983 2.983 2.984 100.00% Amr::coarseTimeStep() 10 2.727 2.727 2.727 91.41% Amr::timeStep() 10 2.685 2.685 2.686 90.03% Castro::advance() 10 2.608 2.63 2.635 88.32% Castro::subcycle_advance_ctu() 10 2.518 2.536 2.549 85.44% Castro::do_advance_ctu() 10 2.517 2.536 2.549 85.44% Castro::construct_ctu_hydro_source() 10 1.543 1.826 1.985 66.52% MultiFab::min() 10 0.0004005 0.1568 0.4587 15.38% FillPatchIterator::Initialize 251 0.1796 0.2052 0.2382 7.99% Castro::initialize_do_advance() 10 0.1996 0.2151 0.23 7.71% FillPatchSingleLevel 251 0.1303 0.1582 0.1987 6.66% Amr::writePlotFile() 2 0.1971 0.1971 0.1971 6.61% FabArray::ParallelCopy() 251 0.08718 0.1233 0.1749 5.86% Castro::clean_state() 62 0.1276 0.1429 0.1623 5.44% Castro::expand_state() 10 0.1372 0.1456 0.155 5.19% Amr::init() 1 0.131 0.1312 0.1314 4.40% FabArray::ParallelCopy_finish() 251 0.04865 0.08035 0.1311 4.39% Castro::computeTemp() 63 0.08734 0.09773 0.1097 3.68% Castro::initialize_advance() 10 0.08333 0.09378 0.1037 3.47% Castro::do_old_sources() 10 0.04342 0.05852 0.09845 3.30% FabArray::setVal() 160 0.07864 0.08676 0.09294 3.12% Castro::do_new_sources() 10 0.06319 0.07498 0.09071 3.04% Castro::post_timestep() 10 0.04971 0.05487 0.07842 2.63% Castro::reset_internal_energy() 63 0.05419 0.06047 0.06822 2.29% VisMF::Write(FabArray) 11 0.04393 0.04873 0.06107 2.05% StateDataPhysBCFunct::() 251 0.02363 0.03473 0.05642 1.89% StateData::FillBoundary(geom) 20 0.02343 0.03451 0.05618 1.88% FabArray::ParallelCopy_nowait() 251 0.03258 0.04273 0.05606 1.88% Castro::estTimeStep() 21 0.0177 0.03102 0.0539 1.81% Amr::checkPoint() 3 0.05068 0.05082 0.05083 1.70% AmrLevel::checkPoint() 3 0.03326 0.03656 0.04269 1.43% StateData::checkPoint() 12 0.03319 0.03649 0.04253 1.43% Amr::initialInit() 1 0.03827 0.03842 0.03857 1.29% Castro::finalize_do_advance() 10 0.002045 0.02427 0.02927 0.98% Castro::construct_new_source() 70 0.02344 0.02656 0.02899 0.97% Castro::volWgtSum() 176 0.02161 0.02503 0.02786 0.93% Amr::InitializeInit() 1 0.01648 0.02529 0.02718 0.91% Amr::defBaseLevel() 1 0.01647 0.02529 0.02718 0.91% Castro::normalize_species() 62 0.01919 0.02225 0.02544 0.85% Castro::construct_new_gravity_source() 10 0.02011 0.02222 0.02423 0.81% Castro::hybrid_to_linear_momentum() 62 0.01644 0.01954 0.02291 0.77% Castro::derive() 187 0.01701 0.0202 0.02288 0.77% Amr::FinalizeInit() 1 0.01117 0.01312 0.02209 0.74% Gravity::get_new_grav_vector() 11 0.01197 0.01529 0.0189 0.63% Castro::construct_new_gravity() 10 0.01147 0.01426 0.0182 0.61% Castro::apply_source_to_state() 20 0.01263 0.01449 0.01668 0.56% MultiFab::Saxpy() 20 0.01258 0.01443 0.01661 0.56% Castro::check_for_nan() 20 0.01005 0.01282 0.01625 0.54% MultiFab::contains_nan() 20 0.01001 0.01278 0.01619 0.54% Castro::computeInitialDt() 2 0.002234 0.004178 0.01315 0.44% Castro::construct_old_source() 70 0.007619 0.01068 0.01302 0.44% Castro::construct_old_gravity() 10 0.01027 0.01185 0.0129 0.43% FabArray::setDomainBndry() 251 0.007441 0.009661 0.01215 0.41% Gravity::get_old_grav_vector() 10 0.009641 0.01109 0.01209 0.41% Castro::initData() 1 0.006979 0.01028 0.01107 0.37% Castro::construct_old_gravity_source() 10 0.005736 0.008386 0.01047 0.35% Gravity::add_pointmass_to_gravity() 21 0.008163 0.009036 0.01015 0.34% Castro::computeNewDt() 9 0.00745 0.008695 0.008841 0.30% Castro::post_init() 1 0.007285 0.007459 0.008385 0.28% Castro::fill_hybrid_hydro_source() 30 0.005044 0.006348 0.0072 0.24% Castro::enforce_min_density() 62 0.004206 0.004842 0.005699 0.19% AmrLevel::AmrLevel(dm) 1 0.003361 0.004594 0.00512 0.17% StateData::define() 4 0.003352 0.004581 0.005108 0.17% Castro::construct_new_hybrid_source() 10 0.003236 0.004208 0.004828 0.16% Castro::swap_state_time_levels() 10 0.004038 0.00439 0.004749 0.16% Castro::post_regrid() 1 0.00166 0.002589 0.002757 0.09% Castro::construct_old_hybrid_source() 10 0.001814 0.002193 0.002641 0.09% Castro::locSquaredSum() 11 0.001023 0.001286 0.001465 0.05% Amr::InitAmr() 1 0.0002841 0.0004233 0.0006419 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 2.219e-05 0.0002704 0.0004304 0.01% DistributionMapping::LeastUsedCPUs() 1 1.321e-05 0.000262 0.0004203 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002176 0.0002488 0.0002766 0.01% Castro::enforce_consistent_e() 1 6.496e-05 9.998e-05 0.0001734 0.01% Castro::finalize_advance() 10 9.733e-05 0.0001384 0.0001687 0.01% FabArrayBase::getCPC() 20 7.957e-05 0.000109 0.0001404 0.00% Amr::writeSmallPlotFile() 1 3.609e-05 6.617e-05 0.0001033 0.00% FabArrayBase::CPC::define() 2 3.044e-05 5.93e-05 8.388e-05 0.00% Castro::enforce_speed_limit() 62 3.855e-05 5.014e-05 6.373e-05 0.00% Gravity::swapTimeLevels() 10 1.652e-05 2.351e-05 3.182e-05 0.00% Castro::create_source_corrector() 10 1.189e-05 2.08e-05 2.99e-05 0.00% Castro::gwstrain() 11 6.685e-06 9.376e-06 1.915e-05 0.00% Amr::initSubcycle() 1 9.498e-06 1.415e-05 1.745e-05 0.00% Castro::construct_new_rotation_source() 10 8.881e-06 1.244e-05 1.537e-05 0.00% Castro::construct_old_rotation_source() 10 5.726e-06 9.095e-06 1.269e-05 0.00% Castro::retry_advance_ctu() 10 6.683e-06 8.836e-06 1.116e-05 0.00% Castro::FluxRegFineAdd() 10 6.445e-06 8.45e-06 1.009e-05 0.00% Gravity::set_mass_offset() 10 5.853e-06 7.361e-06 9.384e-06 0.00% AmrLevel::checkPointPre() 3 3.023e-06 4.392e-06 9.007e-06 0.00% AmrLevel::checkPointPost() 3 4.346e-06 5.642e-06 7.402e-06 0.00% DistributionMapping::Distribute() 1 1.461e-06 2.017e-06 2.643e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.01-35-ge3b1468b8f16) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.01-35-ge3b1468b8f16) initialized Starting run at 07:31:32 UTC on 2022-01-21. Successfully read inputs file ... Castro git describe: 21.12-27-g958e0cc7a AMReX git describe: 22.01-35-ge3b1468b8 Microphysics git describe: 22.01-20-g1a290c72 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 28.36565904 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.038574479 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007351361 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.272947241 Castro::do_new_sources() time = 0.009485592 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7131447673 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.376418363 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006005787 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.262760341 Castro::do_new_sources() time = 0.008775431 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.756583888 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.356707653 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00528937 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.253598246 Castro::do_new_sources() time = 0.009183089 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.772133825 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.348214765 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005674652 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.200320572 Castro::do_new_sources() time = 0.00897281 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9274083516 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.288915717 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006564164 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.180255472 Castro::do_new_sources() time = 0.010990861 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.024352501 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.263122147 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.0203862 seconds Ending run at 07:31:33 UTC on 2022-01-21. Run time = 1.696035375 Run time without initialization = 1.657025852 Average number of zones advanced per microsecond: 0.791 Average number of zones advanced per microsecond per rank: 0.049 TinyProfiler total time across processes [min...avg...max]: 1.695 ... 1.696 ... 1.696 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7735 1.0392 1.1957 70.50% MultiFab::min() 5 0.0002155 0.1484 0.4268 25.17% FabArray::ParallelCopy_finish() 116 0.02647 0.06255 0.1066 6.29% Castro::do_old_sources() 5 7.331e-05 0.01237 0.0572 3.37% FabArray::setVal() 76 0.03683 0.04635 0.05415 3.19% Castro::estTimeStep() 10 0.01014 0.02168 0.03857 2.27% Castro::reset_internal_energy() 30 0.02627 0.03093 0.03846 2.27% FabArray::ParallelCopy_nowait() 116 0.0172 0.02267 0.03255 1.92% StateData::FillBoundary(geom) 10 0.008179 0.02098 0.03103 1.83% FillPatchIterator::Initialize 116 0.01698 0.02243 0.02669 1.57% Castro::expand_state() 5 0.008093 0.01502 0.02464 1.45% Castro::computeTemp() 30 0.01625 0.01926 0.02399 1.41% Castro::do_new_sources() 5 7.272e-05 0.00485 0.02212 1.30% Castro::post_timestep() 5 0.003131 0.01215 0.02167 1.28% VisMF::Read() 3 0.01705 0.01887 0.02026 1.19% Castro::do_advance_ctu() 5 0.01075 0.01701 0.02001 1.18% Castro::initialize_do_advance() 5 0.01076 0.0138 0.01652 0.97% Castro::construct_new_gravity_source() 5 0.01273 0.01438 0.01625 0.96% Castro::finalize_do_advance() 5 0.008954 0.01327 0.01608 0.95% Amr::writePlotFile() 1 0.01197 0.01436 0.01582 0.93% Castro::normalize_species() 30 0.009589 0.01166 0.01527 0.90% Castro::hybrid_to_linear_momentum() 30 0.008307 0.01147 0.01518 0.90% Castro::initialize_advance() 5 0.007867 0.01167 0.01487 0.88% Amr::restart() 1 0.01264 0.0132 0.01354 0.80% MultiFab::contains_nan() 10 0.006267 0.008172 0.01086 0.64% MultiFab::Saxpy() 10 0.006214 0.008142 0.009649 0.57% VisMF::Write(FabArray) 1 0.005247 0.006712 0.009103 0.54% Castro::derive() 86 0.004945 0.006231 0.008407 0.50% Gravity::get_new_grav_vector() 5 0.003485 0.005176 0.007965 0.47% FabArray::setDomainBndry() 116 0.002679 0.005042 0.006865 0.40% Gravity::add_pointmass_to_gravity() 10 0.004053 0.004882 0.00644 0.38% Castro::construct_old_gravity_source() 5 0.002798 0.004521 0.006176 0.36% Castro::post_restart() 1 5.613e-05 0.00191 0.005248 0.31% Castro::swap_state_time_levels() 5 0.004089 0.004546 0.0052 0.31% Castro::fill_hybrid_hydro_source() 15 0.00285 0.003776 0.004602 0.27% StateData::restartDoit() 4 0.002791 0.003654 0.004153 0.24% Gravity::get_old_grav_vector() 5 0.002402 0.003148 0.004124 0.24% Castro::enforce_min_density() 30 0.00209 0.002591 0.003283 0.19% Castro::volWgtSum() 80 0.002445 0.002751 0.003159 0.19% main() 1 0.001566 0.002219 0.00262 0.15% Castro::finalize_advance() 5 0.0008213 0.00122 0.001483 0.09% Castro::subcycle_advance_ctu() 5 2.19e-05 7.116e-05 0.0005765 0.03% Amr::InitAmr() 1 0.0002411 0.0003897 0.0004953 0.03% Castro::locSquaredSum() 6 0.0002221 0.0002957 0.0003863 0.02% Amr::coarseTimeStep() 5 0.0001674 0.0002225 0.0002939 0.02% AmrLevel::restart() 1 0.0001326 0.0002109 0.000272 0.02% DistributionMapping::LeastUsedCPUs() 1 1.441e-05 0.0001729 0.0002392 0.01% Castro::clean_state() 30 7.489e-05 0.0001498 0.0002107 0.01% StateDataPhysBCFunct::() 116 7.308e-05 0.0001178 0.0002039 0.01% FillPatchSingleLevel 116 6.649e-05 9.881e-05 0.0001498 0.01% FabArray::ParallelCopy() 116 6.511e-05 9.127e-05 0.0001282 0.01% Castro::computeNewDt() 5 4.008e-06 1.241e-05 0.00011 0.01% Castro::construct_new_source() 35 2.963e-05 6.742e-05 9.427e-05 0.01% Castro::construct_new_gravity() 5 2.147e-05 4.244e-05 9.184e-05 0.01% FabArrayBase::CPC::define() 2 3.779e-05 5.432e-05 7.976e-05 0.00% Castro::construct_old_source() 35 2.24e-05 4.363e-05 7.165e-05 0.00% Castro::check_for_nan() 10 1.463e-05 3.01e-05 6.62e-05 0.00% Amr::timeStep() 5 2.68e-05 3.624e-05 6.477e-05 0.00% Amr::writeSmallPlotFile() 1 3.602e-05 4.422e-05 6.338e-05 0.00% Castro::construct_old_gravity() 5 1.841e-05 3.959e-05 5.951e-05 0.00% Castro::advance() 5 1.998e-05 3.014e-05 4.445e-05 0.00% Castro::enforce_speed_limit() 30 1.933e-05 3.186e-05 4.318e-05 0.00% Castro::construct_new_hybrid_source() 5 1.033e-05 2.341e-05 4.073e-05 0.00% Castro::apply_source_to_state() 10 1.24e-05 2.508e-05 4.022e-05 0.00% FabArrayBase::getCPC() 10 1.438e-05 2.47e-05 3.634e-05 0.00% Gravity::swapTimeLevels() 5 5.133e-06 1.354e-05 2.429e-05 0.00% Castro::create_source_corrector() 5 5.731e-06 1.29e-05 1.803e-05 0.00% Amr::initSubcycle() 1 8.221e-06 1.371e-05 1.687e-05 0.00% Castro::construct_old_hybrid_source() 5 5.142e-06 1.123e-05 1.685e-05 0.00% Castro::gwstrain() 5 3.45e-06 6.149e-06 1.547e-05 0.00% Gravity::set_mass_offset() 6 4.275e-06 6.053e-06 1.43e-05 0.00% Castro::construct_new_rotation_source() 5 4.339e-06 6.814e-06 1.118e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.486e-06 7.299e-06 9.385e-06 0.00% Amr::init() 1 1.139e-06 2.096e-06 8.426e-06 0.00% Castro::construct_old_rotation_source() 5 2.763e-06 4.839e-06 6.698e-06 0.00% Castro::retry_advance_ctu() 5 3.676e-06 5.328e-06 6.588e-06 0.00% Castro::FluxRegFineAdd() 5 3.255e-06 4.397e-06 5.491e-06 0.00% DistributionMapping::Distribute() 1 1.921e-06 2.376e-06 2.825e-06 0.00% AmrLevel::AmrLevel() 1 1.016e-06 1.743e-06 2.371e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.695 1.696 1.696 100.00% Amr::coarseTimeStep() 5 1.633 1.634 1.634 96.31% Amr::timeStep() 5 1.628 1.628 1.628 95.97% Castro::advance() 5 1.587 1.591 1.594 93.99% Castro::subcycle_advance_ctu() 5 1.525 1.533 1.544 91.03% Castro::do_advance_ctu() 5 1.525 1.533 1.544 91.03% Castro::construct_ctu_hydro_source() 5 0.7735 1.039 1.196 70.50% MultiFab::min() 5 0.0002155 0.1484 0.4268 25.17% FillPatchIterator::Initialize 116 0.1017 0.1341 0.1648 9.71% Castro::initialize_do_advance() 5 0.1164 0.1281 0.1518 8.95% FillPatchSingleLevel 116 0.07236 0.1066 0.1385 8.17% FabArray::ParallelCopy() 116 0.04743 0.08539 0.1278 7.54% FabArray::ParallelCopy_finish() 116 0.02647 0.06255 0.1066 6.29% Castro::expand_state() 5 0.07952 0.09018 0.1059 6.24% Castro::clean_state() 30 0.06294 0.07609 0.09644 5.69% Castro::do_old_sources() 5 0.01885 0.03716 0.07921 4.67% Castro::initialize_advance() 5 0.04174 0.05689 0.0671 3.96% Castro::computeTemp() 30 0.04252 0.05019 0.06245 3.68% Castro::do_new_sources() 5 0.03499 0.04652 0.06199 3.65% FabArray::setVal() 76 0.03683 0.04635 0.05415 3.19% Castro::post_timestep() 5 0.03357 0.03651 0.04122 2.43% Amr::init() 1 0.03829 0.03843 0.0386 2.28% Amr::restart() 1 0.03829 0.03842 0.0386 2.28% Castro::estTimeStep() 10 0.01014 0.02168 0.03857 2.27% Castro::reset_internal_energy() 30 0.02627 0.03093 0.03846 2.27% FabArray::ParallelCopy_nowait() 116 0.01726 0.02275 0.03265 1.93% StateDataPhysBCFunct::() 116 0.008253 0.0211 0.03116 1.84% StateData::FillBoundary(geom) 10 0.008179 0.02098 0.03103 1.83% AmrLevel::restart() 1 0.02033 0.02301 0.02469 1.46% StateData::restartDoit() 4 0.01995 0.02262 0.02423 1.43% Amr::writePlotFile() 1 0.02107 0.02107 0.02107 1.24% VisMF::Read() 3 0.01705 0.01887 0.02026 1.19% Castro::construct_new_source() 35 0.01462 0.01712 0.01962 1.16% Castro::volWgtSum() 80 0.01153 0.01492 0.01897 1.12% Castro::derive() 86 0.009646 0.01274 0.01643 0.97% Castro::construct_new_gravity_source() 5 0.01273 0.01438 0.01625 0.96% Castro::finalize_do_advance() 5 0.008954 0.01327 0.01608 0.95% Castro::normalize_species() 30 0.009589 0.01166 0.01527 0.90% Castro::hybrid_to_linear_momentum() 30 0.008307 0.01147 0.01518 0.90% Castro::construct_new_gravity() 5 0.00637 0.00908 0.01441 0.85% Gravity::get_new_grav_vector() 5 0.005963 0.008576 0.01357 0.80% Castro::check_for_nan() 10 0.00629 0.008202 0.01091 0.64% MultiFab::contains_nan() 10 0.006267 0.008172 0.01086 0.64% Castro::apply_source_to_state() 10 0.006237 0.008167 0.009665 0.57% MultiFab::Saxpy() 10 0.006214 0.008142 0.009649 0.57% VisMF::Write(FabArray) 1 0.005247 0.006712 0.009103 0.54% Castro::construct_old_gravity() 5 0.005373 0.006569 0.008348 0.49% Gravity::get_old_grav_vector() 5 0.004966 0.006152 0.007874 0.46% Castro::construct_old_source() 35 0.003726 0.005713 0.007717 0.46% FabArray::setDomainBndry() 116 0.002679 0.005042 0.006865 0.40% Gravity::add_pointmass_to_gravity() 10 0.004053 0.004882 0.00644 0.38% Castro::construct_old_gravity_source() 5 0.002798 0.004521 0.006176 0.36% Castro::computeNewDt() 5 0.005428 0.005506 0.005553 0.33% Castro::post_restart() 1 0.0003772 0.002207 0.005479 0.32% Castro::swap_state_time_levels() 5 0.004089 0.004546 0.0052 0.31% Castro::fill_hybrid_hydro_source() 15 0.00285 0.003776 0.004602 0.27% Castro::construct_new_hybrid_source() 5 0.001833 0.002667 0.003295 0.19% Castro::enforce_min_density() 30 0.00209 0.002591 0.003283 0.19% Castro::finalize_advance() 5 0.0008262 0.001224 0.001487 0.09% Castro::construct_old_hybrid_source() 5 0.0008582 0.001144 0.001478 0.09% Castro::locSquaredSum() 6 0.0007202 0.0008618 0.0009651 0.06% Amr::InitAmr() 1 0.0002508 0.0004034 0.000512 0.03% DistributionMapping::SFCProcessorMapDoIt() 1 2.412e-05 0.0001826 0.0002508 0.01% DistributionMapping::LeastUsedCPUs() 1 1.441e-05 0.0001729 0.0002392 0.01% FabArrayBase::getCPC() 10 5.216e-05 7.902e-05 0.0001083 0.01% FabArrayBase::CPC::define() 2 3.779e-05 5.432e-05 7.976e-05 0.00% Amr::writeSmallPlotFile() 1 3.602e-05 4.422e-05 6.338e-05 0.00% Castro::enforce_speed_limit() 30 1.933e-05 3.186e-05 4.318e-05 0.00% Gravity::swapTimeLevels() 5 5.133e-06 1.354e-05 2.429e-05 0.00% Castro::create_source_corrector() 5 5.731e-06 1.29e-05 1.803e-05 0.00% Amr::initSubcycle() 1 8.221e-06 1.371e-05 1.687e-05 0.00% Castro::gwstrain() 5 3.45e-06 6.149e-06 1.547e-05 0.00% Gravity::set_mass_offset() 6 4.275e-06 6.053e-06 1.43e-05 0.00% Castro::construct_new_rotation_source() 5 4.339e-06 6.814e-06 1.118e-05 0.00% Castro::construct_old_rotation_source() 5 2.763e-06 4.839e-06 6.698e-06 0.00% Castro::retry_advance_ctu() 5 3.676e-06 5.328e-06 6.588e-06 0.00% Castro::FluxRegFineAdd() 5 3.255e-06 4.397e-06 5.491e-06 0.00% DistributionMapping::Distribute() 1 1.921e-06 2.376e-06 2.825e-06 0.00% AmrLevel::AmrLevel() 1 1.016e-06 1.743e-06 2.371e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.01-35-ge3b1468b8f16) finalized