MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.02-5-g3fb8caaf78a0) initialized Starting run at 07:31:36 UTC on 2022-02-08. Successfully read inputs file ... Castro git describe: 22.02-3-g186ee03f5 AMReX git describe: 22.02-5-g3fb8caaf7 Microphysics git describe: 22.02 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.01751154 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.105832586 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00801754 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273252048 Castro::do_new_sources() time = 0.009510155 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7232278297 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.37163575 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006386337 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.265240726 Castro::do_new_sources() time = 0.008842513 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7571163286 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.359989103 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006783056 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.260105464 Castro::do_new_sources() time = 0.008357408 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7732572195 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.351959521 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006429239 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.213423174 Castro::do_new_sources() time = 0.009149022 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9015195194 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.300692138 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006614731 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.169642749 Castro::do_new_sources() time = 0.010075795 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.104944696 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.246331602 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.017785873 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006504723 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.172856376 Castro::do_new_sources() time = 0.009339227 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.120112246 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.24196579 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004177503 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153830245 Castro::do_new_sources() time = 0.006391364 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.3066035 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.20802675 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003798348 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.154009432 Castro::do_new_sources() time = 0.004987718 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.329280012 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.204209475 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003829634 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.15398997 Castro::do_new_sources() time = 0.005107704 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.333719526 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.203393111 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003806869 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.159177453 Castro::do_new_sources() time = 0.005159007 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.293557155 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.209741988 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.013581536 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.8115137 seconds Ending run at 07:31:40 UTC on 2022-02-08. Run time = 3.707200628 Run time without initialization = 3.542912516 Average number of zones advanced per microsecond: 0.740 Average number of zones advanced per microsecond per rank: 0.046 TinyProfiler total time across processes [min...avg...max]: 3.706 ... 3.707 ... 3.707 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5293 1.7829 1.9888 53.65% Amr::writePlotFile() 2 0.8976 0.9045 0.9055 24.43% MultiFab::min() 10 0.0005072 0.206 0.4723 12.74% FabArray::ParallelCopy_finish() 251 0.04603 0.08353 0.1253 3.38% FabArray::setVal() 164 0.07668 0.08314 0.09129 2.46% Castro::reset_internal_energy() 63 0.0535 0.05955 0.06769 1.83% VisMF::Write(FabArray) 11 0.04423 0.04802 0.06184 1.67% Castro::do_old_sources() 10 0.0001534 0.009947 0.05627 1.52% Castro::estTimeStep() 21 0.01944 0.03449 0.05441 1.47% StateData::FillBoundary(geom) 20 0.02377 0.03371 0.05404 1.46% FabArray::ParallelCopy_nowait() 251 0.03151 0.04105 0.04995 1.35% Castro::post_timestep() 10 0.006678 0.01893 0.0439 1.18% FillPatchIterator::Initialize 251 0.03341 0.0383 0.04222 1.14% Castro::computeTemp() 63 0.03314 0.03667 0.04133 1.11% Castro::do_advance_ctu() 10 0.02631 0.02937 0.03429 0.92% Castro::finalize_do_advance() 10 0.001498 0.02452 0.03264 0.88% Castro::expand_state() 10 0.01755 0.02489 0.03209 0.87% Castro::initialize_do_advance() 10 0.01744 0.02645 0.03061 0.83% Castro::normalize_species() 62 0.01926 0.02186 0.02515 0.68% Castro::construct_new_gravity_source() 10 0.02053 0.02215 0.02383 0.64% Castro::do_new_sources() 10 0.0001387 0.004677 0.02279 0.61% Castro::hybrid_to_linear_momentum() 62 0.01581 0.01932 0.02254 0.61% Castro::initialize_advance() 10 0.01352 0.01681 0.02196 0.59% Amr::checkPoint() 3 0.008258 0.01566 0.01854 0.50% MultiFab::contains_nan() 20 0.01048 0.01295 0.0161 0.43% MultiFab::Saxpy() 20 0.01203 0.01397 0.0157 0.42% FabArray::setDomainBndry() 251 0.006486 0.009825 0.01348 0.36% Castro::derive() 187 0.008563 0.01046 0.01216 0.33% Gravity::get_new_grav_vector() 11 0.006505 0.008945 0.01165 0.31% Castro::construct_old_gravity_source() 10 0.005919 0.007712 0.01059 0.29% Gravity::add_pointmass_to_gravity() 21 0.007936 0.008764 0.009891 0.27% Amr::defBaseLevel() 1 0.004532 0.006686 0.008474 0.23% Castro::fill_hybrid_hydro_source() 30 0.005072 0.006239 0.007089 0.19% Gravity::get_old_grav_vector() 10 0.004431 0.005791 0.006799 0.18% Castro::volWgtSum() 176 0.005137 0.005539 0.005905 0.16% Castro::enforce_min_density() 62 0.004256 0.004811 0.005694 0.15% Castro::swap_state_time_levels() 10 0.004016 0.004556 0.005251 0.14% StateData::define() 4 0.003305 0.004508 0.005236 0.14% Castro::post_init() 1 0.0005654 0.002007 0.005125 0.14% Castro::initData() 1 0.001684 0.002395 0.002935 0.08% main() 1 0.0008463 0.001105 0.001728 0.05% Castro::subcycle_advance_ctu() 10 4.658e-05 0.0001222 0.0009913 0.03% Castro::locSquaredSum() 11 0.0004244 0.0004993 0.0005949 0.02% Amr::InitAmr() 1 0.0002574 0.0003947 0.0005718 0.02% Amr::coarseTimeStep() 10 0.0002694 0.0003447 0.0004746 0.01% DistributionMapping::LeastUsedCPUs() 1 1.147e-05 0.0002154 0.00037 0.01% StateData::checkPoint() 12 1.926e-05 4.826e-05 0.0003451 0.01% Castro::clean_state() 62 0.0001845 0.0002598 0.0003083 0.01% StateDataPhysBCFunct::() 251 0.0001636 0.0002313 0.0002761 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002174 0.0002332 0.0002615 0.01% FillPatchSingleLevel 251 0.0001558 0.0001867 0.0002388 0.01% FabArray::ParallelCopy() 251 0.0001546 0.0001785 0.0002066 0.01% AmrLevel::checkPoint() 3 5.393e-05 7.303e-05 0.0001533 0.00% Castro::construct_new_source() 70 7.911e-05 0.0001147 0.0001513 0.00% Castro::computeNewDt() 9 7.599e-06 1.805e-05 0.000146 0.00% Castro::finalize_advance() 10 0.0001008 0.0001227 0.0001421 0.00% Castro::enforce_consistent_e() 1 6.171e-05 8.763e-05 0.0001386 0.00% Amr::timeStep() 10 5.78e-05 6.761e-05 0.0001107 0.00% Castro::construct_old_source() 70 5.683e-05 8.537e-05 0.0001055 0.00% Castro::construct_old_gravity() 10 4.755e-05 7.808e-05 0.000103 0.00% Castro::construct_new_gravity() 10 3.887e-05 6.002e-05 9.015e-05 0.00% Castro::check_for_nan() 20 3.281e-05 4.874e-05 7.273e-05 0.00% FabArrayBase::getCPC() 20 3.664e-05 4.873e-05 7.203e-05 0.00% FabArrayBase::CPC::define() 2 3.376e-05 5.199e-05 7.183e-05 0.00% Castro::apply_source_to_state() 20 3.931e-05 5.929e-05 6.971e-05 0.00% Amr::writeSmallPlotFile() 1 3.106e-05 4.923e-05 6.832e-05 0.00% Castro::enforce_speed_limit() 62 3.84e-05 4.974e-05 6.114e-05 0.00% Castro::advance() 10 4.274e-05 5.165e-05 5.896e-05 0.00% Amr::FinalizeInit() 1 4.909e-06 9.2e-06 5.07e-05 0.00% Amr::initSubcycle() 1 9.33e-06 1.56e-05 3.989e-05 0.00% Castro::construct_new_hybrid_source() 10 1.821e-05 2.869e-05 3.881e-05 0.00% Castro::create_source_corrector() 10 1.365e-05 2.099e-05 3.204e-05 0.00% Gravity::swapTimeLevels() 10 1.592e-05 2.366e-05 3.077e-05 0.00% Castro::construct_old_hybrid_source() 10 1.33e-05 1.938e-05 2.936e-05 0.00% Castro::gwstrain() 11 7.175e-06 9.778e-06 1.747e-05 0.00% AmrLevel::AmrLevel(dm) 1 8.943e-06 1.209e-05 1.729e-05 0.00% Castro::construct_new_rotation_source() 10 9.284e-06 1.231e-05 1.658e-05 0.00% Castro::FluxRegFineAdd() 10 6.674e-06 9.191e-06 1.168e-05 0.00% Castro::construct_old_rotation_source() 10 5.871e-06 8.411e-06 1.135e-05 0.00% Castro::retry_advance_ctu() 10 5.95e-06 8.965e-06 1.113e-05 0.00% Castro::computeInitialDt() 2 3.376e-06 5.146e-06 1.006e-05 0.00% Amr::InitializeInit() 1 2.502e-06 3.718e-06 9.99e-06 0.00% Amr::init() 1 2.65e-06 3.709e-06 8.799e-06 0.00% Gravity::set_mass_offset() 10 5.748e-06 7.324e-06 8.704e-06 0.00% AmrLevel::checkPointPre() 3 2.835e-06 5.012e-06 8.103e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.465e-06 6.556e-06 8.068e-06 0.00% AmrLevel::checkPointPost() 3 4.563e-06 5.274e-06 6.552e-06 0.00% Castro::post_regrid() 1 3.074e-06 3.843e-06 4.955e-06 0.00% Amr::initialInit() 1 1.496e-06 2.603e-06 4.322e-06 0.00% DistributionMapping::Distribute() 1 1.702e-06 2.125e-06 2.66e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.706 3.707 3.707 100.00% Amr::coarseTimeStep() 10 2.73 2.73 2.73 73.63% Amr::timeStep() 10 2.689 2.689 2.689 72.52% Castro::advance() 10 2.607 2.63 2.638 71.17% Castro::subcycle_advance_ctu() 10 2.524 2.541 2.553 68.87% Castro::do_advance_ctu() 10 2.523 2.541 2.553 68.87% Castro::construct_ctu_hydro_source() 10 1.529 1.783 1.989 53.65% Amr::writePlotFile() 2 0.9176 0.9176 0.9176 24.75% MultiFab::min() 10 0.0005072 0.206 0.4723 12.74% FillPatchIterator::Initialize 251 0.171 0.2071 0.2424 6.54% Castro::initialize_do_advance() 10 0.2028 0.2155 0.2284 6.16% FillPatchSingleLevel 251 0.1222 0.159 0.1958 5.28% FabArray::ParallelCopy() 251 0.08327 0.1249 0.1716 4.63% Amr::init() 1 0.1635 0.1637 0.1639 4.42% Castro::clean_state() 62 0.1274 0.1408 0.1605 4.33% Castro::expand_state() 10 0.1278 0.1459 0.1572 4.24% FabArray::ParallelCopy_finish() 251 0.04603 0.08353 0.1253 3.38% Castro::computeTemp() 63 0.08666 0.09622 0.109 2.94% Castro::do_old_sources() 10 0.03888 0.05493 0.1043 2.81% Castro::initialize_advance() 10 0.07767 0.08923 0.1001 2.70% FabArray::setVal() 164 0.07668 0.08314 0.09129 2.46% Castro::do_new_sources() 10 0.06289 0.07307 0.08989 2.42% Castro::post_timestep() 10 0.05022 0.05845 0.08159 2.20% Castro::reset_internal_energy() 63 0.0535 0.05955 0.06769 1.83% VisMF::Write(FabArray) 11 0.04423 0.04802 0.06184 1.67% Castro::estTimeStep() 21 0.01944 0.03449 0.05441 1.47% StateDataPhysBCFunct::() 251 0.02398 0.03394 0.05431 1.47% StateData::FillBoundary(geom) 20 0.02377 0.03371 0.05404 1.46% Amr::checkPoint() 3 0.05055 0.0507 0.05072 1.37% FabArray::ParallelCopy_nowait() 251 0.0316 0.04115 0.05008 1.35% AmrLevel::checkPoint() 3 0.03214 0.03503 0.04228 1.14% StateData::checkPoint() 12 0.03209 0.03495 0.04213 1.14% Amr::initialInit() 1 0.03851 0.03864 0.03879 1.05% Castro::finalize_do_advance() 10 0.001498 0.02452 0.03264 0.88% Castro::volWgtSum() 176 0.02224 0.02575 0.02936 0.79% Castro::construct_new_source() 70 0.02377 0.02648 0.02834 0.76% Amr::InitializeInit() 1 0.01659 0.02401 0.02723 0.73% Amr::defBaseLevel() 1 0.01659 0.02401 0.02722 0.73% Castro::normalize_species() 62 0.01926 0.02186 0.02515 0.68% Castro::derive() 187 0.01778 0.02098 0.02434 0.66% Castro::construct_new_gravity_source() 10 0.02053 0.02215 0.02383 0.64% Castro::hybrid_to_linear_momentum() 62 0.01581 0.01932 0.02254 0.61% Amr::FinalizeInit() 1 0.0113 0.01463 0.02219 0.60% Gravity::get_new_grav_vector() 11 0.01154 0.01487 0.01885 0.51% Castro::construct_new_gravity() 10 0.01098 0.01413 0.01833 0.49% Castro::check_for_nan() 20 0.01052 0.013 0.01618 0.44% MultiFab::contains_nan() 20 0.01048 0.01295 0.0161 0.43% Castro::apply_source_to_state() 20 0.01208 0.01403 0.01577 0.43% MultiFab::Saxpy() 20 0.01203 0.01397 0.0157 0.42% FabArray::setDomainBndry() 251 0.006486 0.009825 0.01348 0.36% Castro::construct_old_gravity() 10 0.01024 0.0118 0.01344 0.36% Castro::computeInitialDt() 2 0.002507 0.005828 0.01339 0.36% Castro::construct_old_source() 70 0.007785 0.009897 0.01315 0.35% Gravity::get_old_grav_vector() 10 0.009632 0.01104 0.0126 0.34% Castro::construct_old_gravity_source() 10 0.005919 0.007712 0.01059 0.29% Castro::initData() 1 0.006989 0.009495 0.01058 0.29% Gravity::add_pointmass_to_gravity() 21 0.007936 0.008764 0.009891 0.27% Castro::post_init() 1 0.007037 0.007605 0.008462 0.23% Castro::computeNewDt() 9 0.007845 0.00795 0.008019 0.22% Castro::fill_hybrid_hydro_source() 30 0.005072 0.006239 0.007089 0.19% Castro::enforce_min_density() 62 0.004256 0.004811 0.005694 0.15% AmrLevel::AmrLevel(dm) 1 0.003314 0.00452 0.005251 0.14% Castro::swap_state_time_levels() 10 0.004016 0.004556 0.005251 0.14% StateData::define() 4 0.003305 0.004508 0.005236 0.14% Castro::construct_new_hybrid_source() 10 0.003145 0.004196 0.004835 0.13% Castro::post_regrid() 1 0.001581 0.00244 0.003003 0.08% Castro::construct_old_hybrid_source() 10 0.001771 0.002091 0.002443 0.07% Castro::locSquaredSum() 11 0.001081 0.001265 0.00149 0.04% Amr::InitAmr() 1 0.0002668 0.0004103 0.0005876 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.931e-05 0.000224 0.0003795 0.01% DistributionMapping::LeastUsedCPUs() 1 1.147e-05 0.0002154 0.00037 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002174 0.0002332 0.0002615 0.01% Castro::finalize_advance() 10 0.0001086 0.0001319 0.0001516 0.00% Castro::enforce_consistent_e() 1 6.171e-05 8.763e-05 0.0001386 0.00% FabArrayBase::getCPC() 20 7.264e-05 0.0001007 0.0001348 0.00% FabArrayBase::CPC::define() 2 3.376e-05 5.199e-05 7.183e-05 0.00% Amr::writeSmallPlotFile() 1 3.106e-05 4.923e-05 6.832e-05 0.00% Castro::enforce_speed_limit() 62 3.84e-05 4.974e-05 6.114e-05 0.00% Amr::initSubcycle() 1 9.33e-06 1.56e-05 3.989e-05 0.00% Castro::create_source_corrector() 10 1.365e-05 2.099e-05 3.204e-05 0.00% Gravity::swapTimeLevels() 10 1.592e-05 2.366e-05 3.077e-05 0.00% Castro::gwstrain() 11 7.175e-06 9.778e-06 1.747e-05 0.00% Castro::construct_new_rotation_source() 10 9.284e-06 1.231e-05 1.658e-05 0.00% Castro::FluxRegFineAdd() 10 6.674e-06 9.191e-06 1.168e-05 0.00% Castro::construct_old_rotation_source() 10 5.871e-06 8.411e-06 1.135e-05 0.00% Castro::retry_advance_ctu() 10 5.95e-06 8.965e-06 1.113e-05 0.00% Gravity::set_mass_offset() 10 5.748e-06 7.324e-06 8.704e-06 0.00% AmrLevel::checkPointPre() 3 2.835e-06 5.012e-06 8.103e-06 0.00% AmrLevel::checkPointPost() 3 4.563e-06 5.274e-06 6.552e-06 0.00% DistributionMapping::Distribute() 1 1.702e-06 2.125e-06 2.66e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.02-5-g3fb8caaf78a0) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.02-5-g3fb8caaf78a0) initialized Starting run at 07:31:40 UTC on 2022-02-08. Successfully read inputs file ... Castro git describe: 22.02-3-g186ee03f5 AMReX git describe: 22.02-5-g3fb8caaf7 Microphysics git describe: 22.02 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 29.00109531 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.036863578 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007769048 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273351212 Castro::do_new_sources() time = 0.009156838 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7204905677 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.373355132 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007241296 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.265357148 Castro::do_new_sources() time = 0.008862141 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.753456386 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.357848548 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006451456 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.258761033 Castro::do_new_sources() time = 0.008361045 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7688169235 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.35067173 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004721948 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.221407486 Castro::do_new_sources() time = 0.009086214 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8746974688 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.306389496 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005844149 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.167647938 Castro::do_new_sources() time = 0.009430009 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.100550187 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.24453872 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.185822562 seconds Ending run at 07:31:42 UTC on 2022-02-08. Run time = 1.85929247 Run time without initialization = 1.821994895 Average number of zones advanced per microsecond: 0.719 Average number of zones advanced per microsecond per rank: 0.045 TinyProfiler total time across processes [min...avg...max]: 1.859 ... 1.859 ... 1.859 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.8382 1.0574 1.1987 64.47% MultiFab::min() 5 0.0002073 0.1362 0.3622 19.48% Amr::writePlotFile() 1 0.1782 0.18 0.1805 9.71% FabArray::ParallelCopy_finish() 116 0.02735 0.05555 0.08396 4.52% FabArray::setVal() 80 0.03898 0.04588 0.05422 2.92% Castro::do_old_sources() 5 7.888e-05 0.01187 0.05109 2.75% Castro::reset_internal_energy() 30 0.02575 0.03092 0.03894 2.09% StateData::FillBoundary(geom) 10 0.01026 0.02244 0.03822 2.06% FabArray::ParallelCopy_nowait() 116 0.01695 0.02304 0.03309 1.78% FillPatchIterator::Initialize 116 0.01707 0.02324 0.02676 1.44% Castro::estTimeStep() 10 0.009936 0.01649 0.0266 1.43% Castro::post_timestep() 5 0.002549 0.01403 0.0264 1.42% Castro::computeTemp() 30 0.01631 0.01904 0.02349 1.26% Castro::do_new_sources() 5 8.658e-05 0.0062 0.0233 1.25% Castro::finalize_do_advance() 5 0.008831 0.01564 0.02217 1.19% Castro::do_advance_ctu() 5 0.01322 0.01678 0.0203 1.09% VisMF::Read() 3 0.01548 0.01813 0.0201 1.08% Castro::expand_state() 5 0.008854 0.01414 0.0177 0.95% Castro::initialize_do_advance() 5 0.0118 0.01436 0.0167 0.90% Castro::hybrid_to_linear_momentum() 30 0.008456 0.01145 0.01587 0.85% Castro::construct_new_gravity_source() 5 0.01229 0.01394 0.01526 0.82% Castro::normalize_species() 30 0.009411 0.0117 0.01518 0.82% Castro::initialize_advance() 5 0.008482 0.01151 0.01464 0.79% Amr::restart() 1 0.008136 0.01251 0.01315 0.71% MultiFab::contains_nan() 10 0.006304 0.00856 0.01297 0.70% MultiFab::Saxpy() 10 0.006094 0.007899 0.009361 0.50% VisMF::Write(FabArray) 1 0.006276 0.006745 0.008551 0.46% Castro::derive() 86 0.004804 0.006317 0.008139 0.44% Gravity::get_new_grav_vector() 5 0.00336 0.004994 0.007234 0.39% Castro::construct_old_gravity_source() 5 0.002878 0.004261 0.006614 0.36% FabArray::setDomainBndry() 116 0.003003 0.005158 0.006503 0.35% Castro::post_restart() 1 5.004e-05 0.001305 0.005958 0.32% Gravity::add_pointmass_to_gravity() 10 0.003936 0.004759 0.005714 0.31% Castro::swap_state_time_levels() 5 0.00415 0.004661 0.004955 0.27% Castro::fill_hybrid_hydro_source() 15 0.002563 0.003733 0.004438 0.24% StateData::restartDoit() 4 0.002805 0.003724 0.004065 0.22% Gravity::get_old_grav_vector() 5 0.002563 0.003082 0.003814 0.21% DistributionMapping::LeastUsedCPUs() 1 8.064e-06 0.0002745 0.003627 0.20% Castro::enforce_min_density() 30 0.00216 0.002704 0.003479 0.19% Castro::volWgtSum() 80 0.00242 0.002715 0.003304 0.18% main() 1 0.001636 0.002233 0.002422 0.13% Castro::finalize_advance() 5 0.0002327 0.001235 0.00167 0.09% Castro::subcycle_advance_ctu() 5 2.856e-05 7.333e-05 0.0005743 0.03% Amr::InitAmr() 1 0.0002468 0.0003857 0.000449 0.02% Castro::locSquaredSum() 6 0.0002355 0.0003026 0.0004246 0.02% Amr::coarseTimeStep() 5 0.0001906 0.0002401 0.0003143 0.02% AmrLevel::restart() 1 0.0001277 0.0002095 0.0002479 0.01% Castro::clean_state() 30 9.552e-05 0.0001588 0.0002468 0.01% StateDataPhysBCFunct::() 116 7.812e-05 0.0001135 0.0001512 0.01% FillPatchSingleLevel 116 6.967e-05 9.866e-05 0.0001222 0.01% FabArray::ParallelCopy() 116 6.694e-05 9.01e-05 0.0001172 0.01% Castro::computeNewDt() 5 5.014e-06 1.171e-05 9.487e-05 0.01% Castro::construct_new_source() 35 3.968e-05 7.014e-05 9.403e-05 0.01% FabArrayBase::CPC::define() 2 3.361e-05 5.491e-05 9.263e-05 0.00% Castro::construct_new_gravity() 5 2.204e-05 4.199e-05 7.935e-05 0.00% Castro::construct_old_source() 35 2.926e-05 4.349e-05 6.724e-05 0.00% Castro::construct_old_gravity() 5 3.141e-05 4.208e-05 6.221e-05 0.00% Amr::timeStep() 5 2.799e-05 3.552e-05 5.427e-05 0.00% Castro::check_for_nan() 10 1.618e-05 2.857e-05 5.202e-05 0.00% Castro::enforce_speed_limit() 30 2.08e-05 3.305e-05 4.67e-05 0.00% Amr::writeSmallPlotFile() 1 2.68e-05 3.714e-05 4.133e-05 0.00% Castro::apply_source_to_state() 10 1.587e-05 2.578e-05 4.031e-05 0.00% Castro::advance() 5 2.145e-05 2.842e-05 3.728e-05 0.00% Castro::construct_new_hybrid_source() 5 1.153e-05 2.388e-05 3.511e-05 0.00% FabArrayBase::getCPC() 10 2.048e-05 2.485e-05 2.883e-05 0.00% Amr::initSubcycle() 1 8.041e-06 1.343e-05 2.261e-05 0.00% Gravity::swapTimeLevels() 5 7.449e-06 1.311e-05 2.077e-05 0.00% Castro::create_source_corrector() 5 7.219e-06 1.48e-05 2.041e-05 0.00% Castro::gwstrain() 5 3.136e-06 6.38e-06 1.999e-05 0.00% Castro::construct_old_hybrid_source() 5 5.736e-06 1.064e-05 1.919e-05 0.00% Castro::construct_new_rotation_source() 5 4.831e-06 8.112e-06 1.747e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.863e-06 7.118e-06 1.076e-05 0.00% Castro::construct_old_rotation_source() 5 3.035e-06 4.908e-06 7.443e-06 0.00% Castro::retry_advance_ctu() 5 3.474e-06 5.279e-06 6.614e-06 0.00% Gravity::set_mass_offset() 6 3.676e-06 4.892e-06 6.514e-06 0.00% Amr::init() 1 1.025e-06 1.743e-06 6.097e-06 0.00% Castro::FluxRegFineAdd() 5 2.728e-06 4.121e-06 5.574e-06 0.00% AmrLevel::AmrLevel() 1 7.8e-07 1.621e-06 3.214e-06 0.00% DistributionMapping::Distribute() 1 1.408e-06 2.244e-06 2.698e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.859 1.859 1.859 100.00% Amr::coarseTimeStep() 5 1.633 1.633 1.633 87.83% Amr::timeStep() 5 1.627 1.627 1.627 87.52% Castro::advance() 5 1.582 1.589 1.595 85.81% Castro::subcycle_advance_ctu() 5 1.524 1.531 1.542 82.92% Castro::do_advance_ctu() 5 1.524 1.531 1.542 82.91% Castro::construct_ctu_hydro_source() 5 0.8382 1.057 1.199 64.47% MultiFab::min() 5 0.0002073 0.1362 0.3622 19.48% Amr::writePlotFile() 1 0.1868 0.1868 0.1868 10.05% FillPatchIterator::Initialize 116 0.1005 0.1298 0.16 8.60% Castro::initialize_do_advance() 5 0.116 0.1293 0.1433 7.71% FillPatchSingleLevel 116 0.07093 0.1014 0.13 6.99% FabArray::ParallelCopy() 116 0.0445 0.07876 0.1103 5.93% Castro::expand_state() 5 0.08038 0.09022 0.1004 5.40% Castro::clean_state() 30 0.06305 0.07602 0.09703 5.22% FabArray::ParallelCopy_finish() 116 0.02735 0.05555 0.08396 4.52% Castro::do_old_sources() 5 0.01834 0.03601 0.07268 3.91% Castro::initialize_advance() 5 0.04673 0.0568 0.06698 3.60% Castro::computeTemp() 30 0.04215 0.04997 0.0622 3.35% Castro::do_new_sources() 5 0.04075 0.04684 0.05784 3.11% FabArray::setVal() 80 0.03898 0.04588 0.05422 2.92% Castro::post_timestep() 5 0.03175 0.03817 0.04556 2.45% Castro::reset_internal_energy() 30 0.02575 0.03092 0.03894 2.09% StateDataPhysBCFunct::() 116 0.01034 0.02256 0.03834 2.06% StateData::FillBoundary(geom) 10 0.01026 0.02244 0.03822 2.06% Amr::init() 1 0.03663 0.03673 0.0369 1.98% Amr::restart() 1 0.03663 0.03672 0.03689 1.98% FabArray::ParallelCopy_nowait() 116 0.01703 0.02312 0.03318 1.78% AmrLevel::restart() 1 0.01861 0.02246 0.02674 1.44% Castro::estTimeStep() 10 0.009936 0.01649 0.0266 1.43% StateData::restartDoit() 4 0.01837 0.02196 0.02296 1.23% Castro::finalize_do_advance() 5 0.008831 0.01564 0.02217 1.19% VisMF::Read() 3 0.01548 0.01813 0.0201 1.08% Castro::construct_new_source() 35 0.01401 0.01666 0.01832 0.99% Castro::volWgtSum() 80 0.01127 0.01488 0.01825 0.98% Castro::hybrid_to_linear_momentum() 30 0.008456 0.01145 0.01587 0.85% Castro::derive() 86 0.009403 0.01273 0.01569 0.84% Castro::construct_new_gravity_source() 5 0.01229 0.01394 0.01526 0.82% Castro::normalize_species() 30 0.009411 0.0117 0.01518 0.82% Castro::check_for_nan() 10 0.006325 0.008588 0.013 0.70% MultiFab::contains_nan() 10 0.006304 0.00856 0.01297 0.70% Castro::construct_new_gravity() 5 0.00607 0.00872 0.01258 0.68% Gravity::get_new_grav_vector() 5 0.005707 0.008209 0.01178 0.63% Castro::apply_source_to_state() 10 0.006115 0.007925 0.009388 0.50% MultiFab::Saxpy() 10 0.006094 0.007899 0.009361 0.50% VisMF::Write(FabArray) 1 0.006276 0.006745 0.008551 0.46% Castro::construct_old_gravity() 5 0.005189 0.006451 0.008216 0.44% Castro::construct_old_source() 35 0.003753 0.005433 0.00814 0.44% Gravity::get_old_grav_vector() 5 0.004828 0.006032 0.007751 0.42% Castro::construct_old_gravity_source() 5 0.002878 0.004261 0.006614 0.36% FabArray::setDomainBndry() 116 0.003003 0.005158 0.006503 0.35% Castro::post_restart() 1 0.0003651 0.001597 0.006206 0.33% Gravity::add_pointmass_to_gravity() 10 0.003936 0.004759 0.005714 0.31% Castro::computeNewDt() 5 0.005385 0.005458 0.005505 0.30% Castro::swap_state_time_levels() 5 0.00415 0.004661 0.004955 0.27% Castro::fill_hybrid_hydro_source() 15 0.002563 0.003733 0.004438 0.24% DistributionMapping::SFCProcessorMapDoIt() 1 1.63e-05 0.0002839 0.00364 0.20% DistributionMapping::LeastUsedCPUs() 1 8.064e-06 0.0002745 0.003627 0.20% Castro::enforce_min_density() 30 0.00216 0.002704 0.003479 0.19% Castro::construct_new_hybrid_source() 5 0.001627 0.002644 0.003243 0.17% Castro::finalize_advance() 5 0.0002354 0.001239 0.001674 0.09% Castro::construct_old_hybrid_source() 5 0.0008428 0.001124 0.001452 0.08% Castro::locSquaredSum() 6 0.0007331 0.0008677 0.001018 0.05% Amr::InitAmr() 1 0.0002569 0.0003992 0.0004634 0.02% FabArrayBase::getCPC() 10 5.536e-05 7.976e-05 0.0001215 0.01% FabArrayBase::CPC::define() 2 3.361e-05 5.491e-05 9.263e-05 0.00% Castro::enforce_speed_limit() 30 2.08e-05 3.305e-05 4.67e-05 0.00% Amr::writeSmallPlotFile() 1 2.68e-05 3.714e-05 4.133e-05 0.00% Amr::initSubcycle() 1 8.041e-06 1.343e-05 2.261e-05 0.00% Gravity::swapTimeLevels() 5 7.449e-06 1.311e-05 2.077e-05 0.00% Castro::create_source_corrector() 5 7.219e-06 1.48e-05 2.041e-05 0.00% Castro::gwstrain() 5 3.136e-06 6.38e-06 1.999e-05 0.00% Castro::construct_new_rotation_source() 5 4.831e-06 8.112e-06 1.747e-05 0.00% Castro::construct_old_rotation_source() 5 3.035e-06 4.908e-06 7.443e-06 0.00% Castro::retry_advance_ctu() 5 3.474e-06 5.279e-06 6.614e-06 0.00% Gravity::set_mass_offset() 6 3.676e-06 4.892e-06 6.514e-06 0.00% Castro::FluxRegFineAdd() 5 2.728e-06 4.121e-06 5.574e-06 0.00% AmrLevel::AmrLevel() 1 7.8e-07 1.621e-06 3.214e-06 0.00% DistributionMapping::Distribute() 1 1.408e-06 2.244e-06 2.698e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.02-5-g3fb8caaf78a0) finalized