MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-26-g0d136ea53aed) initialized Starting run at 06:45:59 UTC on 2022-04-20. Successfully read inputs file ... Castro git describe: 22.04-12-g78961ce2c AMReX git describe: 22.04-26-g0d136ea53 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017230115 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.199893936 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007498694 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.271662158 Castro::do_new_sources() time = 0.009202135 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7252627654 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.370181025 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006752704 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.259336829 Castro::do_new_sources() time = 0.009089643 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7671170954 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.354544502 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006513985 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.258266413 Castro::do_new_sources() time = 0.00905486 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7771586254 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.349222002 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006361111 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.17484552 Castro::do_new_sources() time = 0.009557195 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.062371338 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.25593725 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005855474 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.16316973 Castro::do_new_sources() time = 0.009500851 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.135823324 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.239170351 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.019048745 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005686879 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.17012893 Castro::do_new_sources() time = 0.008966331 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.130298494 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.240262961 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004037364 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.156234459 Castro::do_new_sources() time = 0.007241553 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.283155108 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.211620697 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003856337 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.157052318 Castro::do_new_sources() time = 0.005149444 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.304755512 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.208221636 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004109695 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.15698098 Castro::do_new_sources() time = 0.005154869 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.307487844 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.207421536 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00421654 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.16492998 Castro::do_new_sources() time = 0.005308989 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.255039165 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.215811731 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.013633304 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 1.156689187 seconds Ending run at 06:46:03 UTC on 2022-04-20. Run time = 4.10149104 Run time without initialization = 3.843803869 Average number of zones advanced per microsecond: 0.682 Average number of zones advanced per microsecond per rank: 0.043 TinyProfiler total time across processes [min...avg...max]: 4.101 ... 4.101 ... 4.102 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.4865 1.7650 1.9504 47.55% Amr::writePlotFile() 2 1.338 1.345 1.346 32.81% MultiFab::min() 10 0.0006114 0.1793 0.4688 11.43% FabArray::ParallelCopy_finish() 251 0.04209 0.08119 0.137 3.34% FabArray::setVal() 164 0.07506 0.08578 0.09321 2.27% Castro::reset_internal_energy() 63 0.05272 0.05882 0.06769 1.65% VisMF::Write(FabArray) 11 0.04245 0.04652 0.06186 1.51% Castro::estTimeStep() 21 0.01893 0.03599 0.05437 1.33% FabArray::ParallelCopy_nowait() 251 0.02956 0.04033 0.05099 1.24% StateData::FillBoundary(geom) 20 0.01914 0.03199 0.05023 1.22% Castro::do_old_sources() 10 0.0001588 0.01114 0.04877 1.19% FillPatchIterator::Initialize 251 0.0325 0.03816 0.04507 1.10% Castro::computeTemp() 63 0.03251 0.03618 0.04101 1.00% Castro::post_timestep() 10 0.005496 0.01806 0.03914 0.95% Castro::do_advance_ctu() 10 0.0205 0.02963 0.03602 0.88% Castro::normalize_species() 62 0.02535 0.02795 0.03215 0.78% Castro::initialize_do_advance() 10 0.01887 0.02582 0.03065 0.75% Castro::finalize_do_advance() 10 0.001582 0.02197 0.02958 0.72% Castro::expand_state() 10 0.01712 0.02369 0.02908 0.71% Castro::construct_new_gravity_source() 10 0.02018 0.02239 0.02387 0.58% Castro::hybrid_to_linear_momentum() 62 0.01618 0.0191 0.02356 0.57% Castro::do_new_sources() 10 0.0001278 0.004515 0.02099 0.51% Castro::initialize_advance() 10 0.01253 0.01698 0.02058 0.50% Amr::checkPoint() 3 0.008252 0.01727 0.02057 0.50% MultiFab::contains_nan() 20 0.01084 0.01262 0.01576 0.38% MultiFab::Saxpy() 20 0.01242 0.01402 0.01548 0.38% Gravity::get_new_grav_vector() 11 0.007285 0.009044 0.01326 0.32% FabArray::setDomainBndry() 251 0.006773 0.0098 0.01279 0.31% Castro::derive() 187 0.00842 0.009924 0.01184 0.29% Gravity::add_pointmass_to_gravity() 21 0.007692 0.008698 0.009755 0.24% Castro::construct_old_gravity_source() 10 0.005347 0.007596 0.00974 0.24% Amr::defBaseLevel() 1 0.004718 0.006717 0.007771 0.19% Gravity::get_old_grav_vector() 10 0.00432 0.005737 0.007295 0.18% Castro::fill_hybrid_hydro_source() 30 0.00497 0.006223 0.006955 0.17% Castro::volWgtSum() 176 0.005107 0.005437 0.00585 0.14% Castro::enforce_min_density() 62 0.003986 0.004598 0.005275 0.13% StateData::define() 4 0.003397 0.004534 0.005127 0.13% Castro::swap_state_time_levels() 10 0.004004 0.004426 0.005006 0.12% Castro::post_init() 1 0.0007441 0.001772 0.00481 0.12% Castro::initData() 1 0.001697 0.002367 0.00266 0.06% main() 1 0.0007504 0.0009896 0.001696 0.04% Castro::subcycle_advance_ctu() 10 4.495e-05 0.0001265 0.001082 0.03% Amr::InitAmr() 1 0.0002756 0.0004065 0.0005774 0.01% Castro::locSquaredSum() 11 0.0003992 0.0004635 0.0005555 0.01% Amr::coarseTimeStep() 10 0.0002634 0.0003528 0.00052 0.01% DistributionMapping::LeastUsedCPUs() 1 1.106e-05 0.0002113 0.0003544 0.01% Castro::clean_state() 62 0.0001658 0.000238 0.000308 0.01% StateData::checkPoint() 12 2.562e-05 5.087e-05 0.0003029 0.01% StateDataPhysBCFunct::() 251 0.0001355 0.0002135 0.0002817 0.01% Castro::linear_to_hybrid_momentum() 1 0.00022 0.0002363 0.0002569 0.01% FillPatchSingleLevel 251 0.0001296 0.0001757 0.0002112 0.01% FabArray::ParallelCopy() 251 0.000125 0.000166 0.0002023 0.00% Castro::computeNewDt() 9 6.539e-06 1.938e-05 0.0001812 0.00% Castro::enforce_consistent_e() 1 6.387e-05 9.569e-05 0.0001613 0.00% Castro::finalize_advance() 10 0.0001005 0.0001198 0.0001463 0.00% Castro::construct_new_source() 70 7.28e-05 0.0001123 0.0001432 0.00% AmrLevel::checkPoint() 3 4.434e-05 6.849e-05 0.0001413 0.00% Castro::construct_old_source() 70 5.859e-05 7.923e-05 0.0001146 0.00% Castro::construct_new_gravity() 10 2.981e-05 5.984e-05 0.0001129 0.00% Amr::timeStep() 10 5.065e-05 6.501e-05 0.0001102 0.00% Castro::construct_old_gravity() 10 4.177e-05 7.366e-05 9.423e-05 0.00% FabArrayBase::CPC::define() 2 2.815e-05 5.209e-05 8.427e-05 0.00% Castro::check_for_nan() 20 3.087e-05 4.85e-05 7.523e-05 0.00% Amr::writeSmallPlotFile() 1 3.149e-05 5.441e-05 7.519e-05 0.00% Castro::apply_source_to_state() 20 4.251e-05 5.69e-05 7.274e-05 0.00% Castro::advance() 10 3.69e-05 5.098e-05 6.674e-05 0.00% FabArrayBase::getCPC() 20 2.951e-05 4.536e-05 5.622e-05 0.00% Castro::enforce_speed_limit() 62 3.31e-05 4.576e-05 5.404e-05 0.00% Amr::FinalizeInit() 1 4.161e-06 9.421e-06 5.039e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.836e-05 2.794e-05 4.828e-05 0.00% Castro::construct_new_hybrid_source() 10 1.774e-05 3.152e-05 4.483e-05 0.00% Castro::create_source_corrector() 10 1.29e-05 2.052e-05 3.087e-05 0.00% Gravity::swapTimeLevels() 10 1.522e-05 2.249e-05 2.897e-05 0.00% Castro::construct_old_hybrid_source() 10 1.286e-05 1.993e-05 2.806e-05 0.00% Amr::initSubcycle() 1 9.348e-06 1.346e-05 1.755e-05 0.00% Castro::construct_new_rotation_source() 10 7.611e-06 1.19e-05 1.612e-05 0.00% Castro::FluxRegFineAdd() 10 7.469e-06 9.16e-06 1.158e-05 0.00% Castro::retry_advance_ctu() 10 7.823e-06 9.273e-06 1.099e-05 0.00% Castro::construct_old_rotation_source() 10 5.007e-06 7.709e-06 1.048e-05 0.00% Castro::gwstrain() 11 6.096e-06 8.128e-06 9.57e-06 0.00% Gravity::set_mass_offset() 10 5.648e-06 7.003e-06 8.637e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.08e-06 6.725e-06 8.585e-06 0.00% Amr::InitializeInit() 1 2.544e-06 3.649e-06 7.814e-06 0.00% Castro::computeInitialDt() 2 2.861e-06 4.779e-06 7.262e-06 0.00% AmrLevel::checkPointPre() 3 2.828e-06 4.704e-06 6.998e-06 0.00% AmrLevel::checkPointPost() 3 4.091e-06 5.419e-06 6.623e-06 0.00% Amr::initialInit() 1 1.798e-06 2.975e-06 5.795e-06 0.00% Castro::post_regrid() 1 3.184e-06 3.879e-06 4.782e-06 0.00% Amr::init() 1 3.088e-06 3.469e-06 3.785e-06 0.00% DistributionMapping::Distribute() 1 1.716e-06 2.197e-06 2.773e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 4.101 4.101 4.102 100.00% Amr::coarseTimeStep() 10 2.685 2.686 2.686 65.48% Amr::timeStep() 10 2.642 2.642 2.642 64.42% Castro::advance() 10 2.565 2.585 2.593 63.21% Castro::subcycle_advance_ctu() 10 2.479 2.493 2.504 61.05% Castro::do_advance_ctu() 10 2.478 2.493 2.504 61.05% Castro::construct_ctu_hydro_source() 10 1.487 1.765 1.95 47.55% Amr::writePlotFile() 2 1.357 1.357 1.357 33.08% MultiFab::min() 10 0.0006114 0.1793 0.4688 11.43% Amr::init() 1 0.2569 0.2571 0.2573 6.27% FillPatchIterator::Initialize 251 0.177 0.2021 0.2369 5.78% Castro::initialize_do_advance() 10 0.1975 0.2158 0.2354 5.74% FillPatchSingleLevel 251 0.131 0.1542 0.1968 4.80% FabArray::ParallelCopy() 251 0.0803 0.1218 0.1773 4.32% Castro::clean_state() 62 0.1314 0.1453 0.1682 4.10% Castro::expand_state() 10 0.1337 0.1452 0.1543 3.76% FabArray::ParallelCopy_finish() 251 0.04209 0.08119 0.137 3.34% Castro::computeTemp() 63 0.08523 0.095 0.1087 2.65% Castro::initialize_advance() 10 0.07666 0.09205 0.1031 2.51% FabArray::setVal() 164 0.07506 0.08578 0.09321 2.27% Castro::do_old_sources() 10 0.04216 0.05585 0.09194 2.24% Castro::do_new_sources() 10 0.06785 0.07431 0.0908 2.21% Castro::post_timestep() 10 0.04955 0.05715 0.07757 1.89% Castro::reset_internal_energy() 63 0.05272 0.05882 0.06769 1.65% VisMF::Write(FabArray) 11 0.04245 0.04652 0.06186 1.51% Castro::estTimeStep() 21 0.01893 0.03599 0.05437 1.33% Amr::checkPoint() 3 0.05157 0.0517 0.05172 1.26% FabArray::ParallelCopy_nowait() 251 0.02964 0.04043 0.0511 1.25% StateDataPhysBCFunct::() 251 0.01933 0.0322 0.05052 1.23% StateData::FillBoundary(geom) 20 0.01914 0.03199 0.05023 1.22% AmrLevel::checkPoint() 3 0.03113 0.03442 0.04331 1.06% StateData::checkPoint() 12 0.03107 0.03436 0.04316 1.05% Amr::initialInit() 1 0.03814 0.03825 0.03839 0.94% Castro::normalize_species() 62 0.02535 0.02795 0.03215 0.78% Castro::finalize_do_advance() 10 0.001582 0.02197 0.02958 0.72% Castro::construct_new_source() 70 0.02362 0.02672 0.02896 0.71% Castro::volWgtSum() 176 0.02146 0.02469 0.02814 0.69% Amr::InitializeInit() 1 0.0174 0.02452 0.02715 0.66% Amr::defBaseLevel() 1 0.01739 0.02452 0.02715 0.66% Castro::construct_new_gravity_source() 10 0.02018 0.02239 0.02387 0.58% Castro::hybrid_to_linear_momentum() 62 0.01618 0.0191 0.02356 0.57% Castro::derive() 187 0.01703 0.02005 0.02331 0.57% Castro::construct_new_gravity() 10 0.01174 0.01421 0.02103 0.51% Amr::FinalizeInit() 1 0.01105 0.01372 0.02099 0.51% Gravity::get_new_grav_vector() 11 0.01236 0.01497 0.02087 0.51% Castro::check_for_nan() 20 0.01088 0.01267 0.01584 0.39% MultiFab::contains_nan() 20 0.01084 0.01262 0.01576 0.38% Castro::apply_source_to_state() 20 0.01247 0.01408 0.01554 0.38% MultiFab::Saxpy() 20 0.01242 0.01402 0.01548 0.38% Castro::construct_old_gravity() 10 0.009727 0.01156 0.01288 0.31% FabArray::setDomainBndry() 251 0.006773 0.0098 0.01279 0.31% Castro::computeInitialDt() 2 0.002409 0.00507 0.01234 0.30% Castro::construct_old_source() 70 0.007073 0.009753 0.01221 0.30% Gravity::get_old_grav_vector() 10 0.009157 0.01082 0.01207 0.29% Castro::initData() 1 0.007189 0.009834 0.01108 0.27% Gravity::add_pointmass_to_gravity() 21 0.007692 0.008698 0.009755 0.24% Castro::construct_old_gravity_source() 10 0.005347 0.007596 0.00974 0.24% Castro::computeNewDt() 9 0.008508 0.008594 0.008657 0.21% Castro::post_init() 1 0.007108 0.007394 0.00823 0.20% Castro::fill_hybrid_hydro_source() 30 0.00497 0.006223 0.006955 0.17% Castro::enforce_min_density() 62 0.003986 0.004598 0.005275 0.13% AmrLevel::AmrLevel(dm) 1 0.003415 0.004562 0.00515 0.13% StateData::define() 4 0.003397 0.004534 0.005127 0.13% Castro::swap_state_time_levels() 10 0.004004 0.004426 0.005006 0.12% Castro::construct_new_hybrid_source() 10 0.003234 0.004205 0.004945 0.12% Castro::post_regrid() 1 0.001702 0.002541 0.002833 0.07% Castro::construct_old_hybrid_source() 10 0.001662 0.00207 0.002342 0.06% Castro::locSquaredSum() 11 0.001025 0.00126 0.001679 0.04% Amr::InitAmr() 1 0.000285 0.00042 0.0005919 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.912e-05 0.0002203 0.0003645 0.01% DistributionMapping::LeastUsedCPUs() 1 1.106e-05 0.0002113 0.0003544 0.01% Castro::linear_to_hybrid_momentum() 1 0.00022 0.0002363 0.0002569 0.01% Castro::enforce_consistent_e() 1 6.387e-05 9.569e-05 0.0001613 0.00% Castro::finalize_advance() 10 0.0001094 0.0001289 0.0001567 0.00% FabArrayBase::getCPC() 20 5.766e-05 9.745e-05 0.0001348 0.00% FabArrayBase::CPC::define() 2 2.815e-05 5.209e-05 8.427e-05 0.00% Amr::writeSmallPlotFile() 1 3.149e-05 5.441e-05 7.519e-05 0.00% Castro::enforce_speed_limit() 62 3.31e-05 4.576e-05 5.404e-05 0.00% Castro::create_source_corrector() 10 1.29e-05 2.052e-05 3.087e-05 0.00% Gravity::swapTimeLevels() 10 1.522e-05 2.249e-05 2.897e-05 0.00% Amr::initSubcycle() 1 9.348e-06 1.346e-05 1.755e-05 0.00% Castro::construct_new_rotation_source() 10 7.611e-06 1.19e-05 1.612e-05 0.00% Castro::FluxRegFineAdd() 10 7.469e-06 9.16e-06 1.158e-05 0.00% Castro::retry_advance_ctu() 10 7.823e-06 9.273e-06 1.099e-05 0.00% Castro::construct_old_rotation_source() 10 5.007e-06 7.709e-06 1.048e-05 0.00% Castro::gwstrain() 11 6.096e-06 8.128e-06 9.57e-06 0.00% Gravity::set_mass_offset() 10 5.648e-06 7.003e-06 8.637e-06 0.00% AmrLevel::checkPointPre() 3 2.828e-06 4.704e-06 6.998e-06 0.00% AmrLevel::checkPointPost() 3 4.091e-06 5.419e-06 6.623e-06 0.00% DistributionMapping::Distribute() 1 1.716e-06 2.197e-06 2.773e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-26-g0d136ea53aed) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-26-g0d136ea53aed) initialized Starting run at 06:46:03 UTC on 2022-04-20. Successfully read inputs file ... Castro git describe: 22.04-12-g78961ce2c AMReX git describe: 22.04-26-g0d136ea53 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 29.53075726 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.052028182 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007164073 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.276610094 Castro::do_new_sources() time = 0.009307548 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7134927978 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.37739254 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006475116 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.265652368 Castro::do_new_sources() time = 0.008876561 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7563949463 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.358286165 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005346003 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.252119262 Castro::do_new_sources() time = 0.0085488 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7871995392 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.343994103 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006224402 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.172352874 Castro::do_new_sources() time = 0.009120978 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.076528935 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.251361317 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007272298 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.169019368 Castro::do_new_sources() time = 0.009907152 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.092978537 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.247052366 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.175964699 seconds Ending run at 06:46:05 UTC on 2022-04-20. Run time = 1.809810358 Run time without initialization = 1.757369957 Average number of zones advanced per microsecond: 0.746 Average number of zones advanced per microsecond per rank: 0.047 TinyProfiler total time across processes [min...avg...max]: 1.809 ... 1.81 ... 1.81 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7247 1.0194 1.1517 63.63% MultiFab::min() 5 0.0002305 0.1209 0.4247 23.47% Amr::writePlotFile() 1 0.1679 0.1698 0.1706 9.42% FabArray::ParallelCopy_finish() 116 0.02681 0.05814 0.1035 5.72% Castro::do_old_sources() 5 8.053e-05 0.01149 0.05374 2.97% FabArray::setVal() 80 0.03899 0.0464 0.05367 2.97% Castro::reset_internal_energy() 30 0.02596 0.03055 0.03912 2.16% StateData::FillBoundary(geom) 10 0.01056 0.02087 0.03483 1.92% Castro::estTimeStep() 10 0.009569 0.0175 0.03423 1.89% FabArray::ParallelCopy_nowait() 116 0.01637 0.02267 0.03075 1.70% Amr::restart() 1 0.0273 0.02761 0.02776 1.53% FillPatchIterator::Initialize 116 0.01728 0.02323 0.02768 1.53% Castro::do_new_sources() 5 7.017e-05 0.00545 0.02351 1.30% Castro::computeTemp() 30 0.01631 0.01871 0.02336 1.29% Castro::post_timestep() 5 0.004793 0.01214 0.02212 1.22% Castro::expand_state() 5 0.009644 0.01409 0.01961 1.08% VisMF::Read() 3 0.01693 0.0186 0.01918 1.06% Castro::do_advance_ctu() 5 0.01175 0.01605 0.01917 1.06% Castro::normalize_species() 30 0.01228 0.01471 0.01892 1.05% Castro::finalize_do_advance() 5 0.008797 0.01421 0.01774 0.98% Castro::initialize_do_advance() 5 0.01199 0.01387 0.01673 0.92% Castro::hybrid_to_linear_momentum() 30 0.008957 0.01134 0.0163 0.90% Castro::construct_new_gravity_source() 5 0.01225 0.01387 0.01537 0.85% Castro::initialize_advance() 5 0.008847 0.01162 0.01494 0.83% MultiFab::contains_nan() 10 0.006366 0.008273 0.01102 0.61% MultiFab::Saxpy() 10 0.007417 0.008615 0.009265 0.51% VisMF::Write(FabArray) 1 0.006384 0.007139 0.009082 0.50% Castro::derive() 86 0.005115 0.006166 0.00799 0.44% Gravity::get_new_grav_vector() 5 0.003616 0.004964 0.007136 0.39% FabArray::setDomainBndry() 116 0.003169 0.005114 0.00697 0.39% Gravity::add_pointmass_to_gravity() 10 0.004122 0.00482 0.005785 0.32% Castro::construct_old_gravity_source() 5 0.003057 0.004696 0.005745 0.32% Castro::swap_state_time_levels() 5 0.004147 0.00441 0.004589 0.25% Castro::post_restart() 1 6.73e-05 0.001163 0.004422 0.24% Castro::fill_hybrid_hydro_source() 15 0.002568 0.003704 0.004377 0.24% StateData::restartDoit() 4 0.00283 0.003685 0.003975 0.22% Gravity::get_old_grav_vector() 5 0.002161 0.003195 0.003674 0.20% Castro::enforce_min_density() 30 0.002193 0.002527 0.003139 0.17% Castro::volWgtSum() 80 0.002543 0.00271 0.003064 0.17% main() 1 0.001545 0.00207 0.002348 0.13% Castro::finalize_advance() 5 0.000226 0.0008422 0.001436 0.08% Castro::subcycle_advance_ctu() 5 2.849e-05 6.489e-05 0.0004847 0.03% Amr::InitAmr() 1 0.0002561 0.0003795 0.0004691 0.03% Castro::locSquaredSum() 6 0.0002228 0.0002861 0.0003851 0.02% Amr::coarseTimeStep() 5 0.0001699 0.0002288 0.0002835 0.02% AmrLevel::restart() 1 0.0001467 0.0002383 0.0002802 0.02% Castro::clean_state() 30 8.317e-05 0.0001431 0.0001965 0.01% StateDataPhysBCFunct::() 116 7.444e-05 0.0001123 0.0001465 0.01% FillPatchSingleLevel 116 6.664e-05 9.498e-05 0.0001262 0.01% FabArray::ParallelCopy() 116 6.119e-05 8.47e-05 0.0001116 0.01% Castro::construct_new_source() 35 3.352e-05 7.282e-05 0.0001061 0.01% FabArrayBase::CPC::define() 2 3.454e-05 5.541e-05 9.609e-05 0.01% Castro::computeNewDt() 5 4.574e-06 1.098e-05 8.611e-05 0.00% Castro::construct_old_gravity() 5 2.586e-05 4.325e-05 6.6e-05 0.00% Castro::construct_old_source() 35 2.731e-05 4.633e-05 6.18e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 8.964e-06 2.956e-05 5.944e-05 0.00% Castro::construct_new_gravity() 5 1.49e-05 3.67e-05 5.694e-05 0.00% Castro::check_for_nan() 10 1.422e-05 2.842e-05 4.604e-05 0.00% Amr::writeSmallPlotFile() 1 2.714e-05 3.557e-05 4.018e-05 0.00% Amr::timeStep() 5 2.788e-05 3.322e-05 3.941e-05 0.00% Castro::enforce_speed_limit() 30 1.951e-05 3.045e-05 3.883e-05 0.00% Castro::apply_source_to_state() 10 1.658e-05 2.695e-05 3.845e-05 0.00% FabArrayBase::getCPC() 10 1.457e-05 2.535e-05 3.503e-05 0.00% Castro::construct_new_hybrid_source() 5 9.964e-06 2.457e-05 3.437e-05 0.00% Castro::advance() 5 2.038e-05 2.817e-05 3.38e-05 0.00% Castro::create_source_corrector() 5 6.933e-06 1.411e-05 2.109e-05 0.00% Castro::gwstrain() 5 3.688e-06 6.462e-06 1.845e-05 0.00% Amr::initSubcycle() 1 8.593e-06 1.366e-05 1.739e-05 0.00% Castro::construct_old_hybrid_source() 5 6.012e-06 1.086e-05 1.712e-05 0.00% Gravity::swapTimeLevels() 5 6.95e-06 1.181e-05 1.508e-05 0.00% Castro::construct_old_rotation_source() 5 2.506e-06 5.144e-06 1.308e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 6.209e-06 7.473e-06 9.508e-06 0.00% Castro::construct_new_rotation_source() 5 4.212e-06 6.391e-06 8.337e-06 0.00% Castro::FluxRegFineAdd() 5 2.747e-06 4.241e-06 7.34e-06 0.00% Gravity::set_mass_offset() 6 3.497e-06 4.886e-06 6.332e-06 0.00% Castro::retry_advance_ctu() 5 3.871e-06 4.97e-06 6.086e-06 0.00% DistributionMapping::Distribute() 1 1.691e-06 2.385e-06 2.743e-06 0.00% AmrLevel::AmrLevel() 1 1.111e-06 2.055e-06 2.493e-06 0.00% Amr::init() 1 8.27e-07 1.425e-06 1.968e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.809 1.81 1.81 100.00% Amr::coarseTimeStep() 5 1.578 1.578 1.578 87.20% Amr::timeStep() 5 1.573 1.573 1.573 86.90% Castro::advance() 5 1.53 1.536 1.54 85.09% Castro::subcycle_advance_ctu() 5 1.471 1.479 1.485 82.05% Castro::do_advance_ctu() 5 1.471 1.479 1.485 82.05% Castro::construct_ctu_hydro_source() 5 0.7247 1.019 1.152 63.63% MultiFab::min() 5 0.0002305 0.1209 0.4247 23.47% Amr::writePlotFile() 1 0.1769 0.1769 0.177 9.78% FillPatchIterator::Initialize 116 0.1001 0.1304 0.1562 8.63% Castro::initialize_do_advance() 5 0.118 0.1288 0.1463 8.08% FillPatchSingleLevel 116 0.078 0.1021 0.1358 7.50% FabArray::ParallelCopy() 116 0.04677 0.08098 0.125 6.91% FabArray::ParallelCopy_finish() 116 0.02681 0.05814 0.1035 5.72% Castro::clean_state() 30 0.06662 0.07801 0.101 5.58% Castro::expand_state() 5 0.08212 0.08944 0.09821 5.43% Castro::do_old_sources() 5 0.02363 0.03719 0.07904 4.37% Castro::initialize_advance() 5 0.04713 0.05698 0.06669 3.68% Castro::computeTemp() 30 0.04235 0.04926 0.06248 3.45% Castro::do_new_sources() 5 0.03453 0.04653 0.05889 3.25% FabArray::setVal() 80 0.03899 0.0464 0.05367 2.97% Amr::init() 1 0.0518 0.05189 0.05206 2.88% Amr::restart() 1 0.0518 0.05189 0.05206 2.88% Castro::post_timestep() 5 0.03272 0.03627 0.04233 2.34% Castro::reset_internal_energy() 30 0.02596 0.03055 0.03912 2.16% StateDataPhysBCFunct::() 116 0.01066 0.02098 0.03495 1.93% StateData::FillBoundary(geom) 10 0.01056 0.02087 0.03483 1.92% Castro::estTimeStep() 10 0.009569 0.0175 0.03423 1.89% FabArray::ParallelCopy_nowait() 116 0.01642 0.02275 0.03083 1.70% AmrLevel::restart() 1 0.02004 0.02267 0.02354 1.30% StateData::restartDoit() 4 0.01981 0.0224 0.02326 1.28% VisMF::Read() 3 0.01693 0.0186 0.01918 1.06% Castro::normalize_species() 30 0.01228 0.01471 0.01892 1.05% Castro::construct_new_source() 35 0.01402 0.01655 0.0178 0.98% Castro::volWgtSum() 80 0.01179 0.01465 0.01777 0.98% Castro::finalize_do_advance() 5 0.008797 0.01421 0.01774 0.98% Castro::hybrid_to_linear_momentum() 30 0.008957 0.01134 0.0163 0.90% Castro::construct_new_gravity_source() 5 0.01225 0.01387 0.01537 0.85% Castro::derive() 86 0.009918 0.01249 0.01533 0.85% Castro::construct_new_gravity() 5 0.006525 0.008711 0.01245 0.69% Gravity::get_new_grav_vector() 5 0.006203 0.008247 0.01174 0.65% Castro::check_for_nan() 10 0.006389 0.008301 0.01107 0.61% MultiFab::contains_nan() 10 0.006366 0.008273 0.01102 0.61% Castro::apply_source_to_state() 10 0.00744 0.008642 0.009291 0.51% MultiFab::Saxpy() 10 0.007417 0.008615 0.009265 0.51% VisMF::Write(FabArray) 1 0.006384 0.007139 0.009082 0.50% Castro::construct_old_gravity() 5 0.005874 0.006635 0.007549 0.42% Castro::construct_old_source() 35 0.004043 0.005891 0.007267 0.40% Gravity::get_old_grav_vector() 5 0.00547 0.006225 0.007145 0.39% FabArray::setDomainBndry() 116 0.003169 0.005114 0.00697 0.39% Gravity::add_pointmass_to_gravity() 10 0.004122 0.00482 0.005785 0.32% Castro::construct_old_gravity_source() 5 0.003057 0.004696 0.005745 0.32% Castro::computeNewDt() 5 0.005166 0.005235 0.005292 0.29% Castro::post_restart() 1 0.0004147 0.001459 0.00462 0.26% Castro::swap_state_time_levels() 5 0.004147 0.00441 0.004589 0.25% Castro::fill_hybrid_hydro_source() 15 0.002568 0.003704 0.004377 0.24% Castro::enforce_min_density() 30 0.002193 0.002527 0.003139 0.17% Castro::construct_new_hybrid_source() 5 0.001698 0.002596 0.003129 0.17% Castro::construct_old_hybrid_source() 5 0.0008873 0.001143 0.001466 0.08% Castro::finalize_advance() 5 0.0002296 0.0008464 0.00144 0.08% Castro::locSquaredSum() 6 0.0006627 0.0008384 0.0009956 0.06% Amr::InitAmr() 1 0.0002655 0.0003932 0.000484 0.03% FabArrayBase::getCPC() 10 4.91e-05 8.076e-05 0.0001243 0.01% FabArrayBase::CPC::define() 2 3.454e-05 5.541e-05 9.609e-05 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.804e-05 3.942e-05 7.136e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 8.964e-06 2.956e-05 5.944e-05 0.00% Amr::writeSmallPlotFile() 1 2.714e-05 3.557e-05 4.018e-05 0.00% Castro::enforce_speed_limit() 30 1.951e-05 3.045e-05 3.883e-05 0.00% Castro::create_source_corrector() 5 6.933e-06 1.411e-05 2.109e-05 0.00% Castro::gwstrain() 5 3.688e-06 6.462e-06 1.845e-05 0.00% Amr::initSubcycle() 1 8.593e-06 1.366e-05 1.739e-05 0.00% Gravity::swapTimeLevels() 5 6.95e-06 1.181e-05 1.508e-05 0.00% Castro::construct_old_rotation_source() 5 2.506e-06 5.144e-06 1.308e-05 0.00% Castro::construct_new_rotation_source() 5 4.212e-06 6.391e-06 8.337e-06 0.00% Castro::FluxRegFineAdd() 5 2.747e-06 4.241e-06 7.34e-06 0.00% Gravity::set_mass_offset() 6 3.497e-06 4.886e-06 6.332e-06 0.00% Castro::retry_advance_ctu() 5 3.871e-06 4.97e-06 6.086e-06 0.00% DistributionMapping::Distribute() 1 1.691e-06 2.385e-06 2.743e-06 0.00% AmrLevel::AmrLevel() 1 1.111e-06 2.055e-06 2.493e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-26-g0d136ea53aed) finalized