MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-39-g50466d11e7b2) initialized Starting run at 23:16:16 UTC on 2022-04-30. Successfully read inputs file ... Castro git describe: 22.04-49-g7653ce36f AMReX git describe: 22.04-39-g50466d11e Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017627362 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.468566634 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008640744 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.290571388 Castro::do_new_sources() time = 0.009607671 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.691085796 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.388673769 [STEP 1] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007420147 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.285195701 Castro::do_new_sources() time = 0.009880075 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7181125094 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.378447926 [STEP 2] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007045502 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.273074362 Castro::do_new_sources() time = 0.009004437 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7443662826 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.36455167 [STEP 3] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005636179 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.268087261 Castro::do_new_sources() time = 0.009816003 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7572180928 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.357627426 [STEP 4] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007231631 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.247890732 Castro::do_new_sources() time = 0.009932147 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.8078831775 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.334446391 [STEP 5] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.015714524 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005438456 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.182341898 Castro::do_new_sources() time = 0.008108679 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.095133073 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.247228587 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004199024 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.166599138 Castro::do_new_sources() time = 0.005686807 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.228491942 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.220529485 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004040118 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.179176267 Castro::do_new_sources() time = 0.008542 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.136243597 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.240294822 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005032042 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.192133817 Castro::do_new_sources() time = 0.007480799 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.036342917 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.26085927 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00450386 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.175015982 Castro::do_new_sources() time = 0.007065925 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.150697463 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.235344049 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.013942402 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.030906928 seconds Ending run at 23:16:20 UTC on 2022-04-30. Run time = 3.620049123 Run time without initialization = 3.090607554 Average number of zones advanced per microsecond: 0.848 Average number of zones advanced per microsecond per rank: 0.053 TinyProfiler total time across processes [min...avg...max]: 3.62 ... 3.62 ... 3.62 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.7031 2.0174 2.2749 62.84% Castro::do_advance_ctu() 10 0.02802 0.2804 0.605 16.71% Amr::writePlotFile() 2 0.48 0.4875 0.4884 13.49% FabArray::ParallelCopy_finish() 251 0.06344 0.1028 0.1587 4.38% FabArray::setVal() 164 0.05624 0.07718 0.09429 2.60% Castro::do_old_sources() 10 0.0001684 0.01602 0.09004 2.49% Castro::estTimeStep() 21 0.0232 0.05153 0.07839 2.17% Castro::reset_internal_energy(Fab) 504 0.05426 0.06365 0.07502 2.07% VisMF::Write(FabArray) 11 0.03979 0.04506 0.0612 1.69% StateData::FillBoundary(geom) 20 0.01836 0.03535 0.05418 1.50% FabArray::ParallelCopy_nowait() 251 0.03097 0.04053 0.05262 1.45% Castro::do_new_sources() 10 0.0001164 0.009206 0.05046 1.39% Castro::post_timestep() 10 0.01019 0.02279 0.04807 1.33% Castro::computeTemp() 63 0.0335 0.03916 0.04471 1.23% FillPatchIterator::Initialize 251 0.03055 0.03774 0.04286 1.18% Castro::normalize_species() 62 0.02476 0.02977 0.03454 0.95% Castro::finalize_do_advance() 10 0.001097 0.02331 0.03177 0.88% Castro::initialize_do_advance() 10 0.01697 0.02621 0.03059 0.84% Castro::expand_state() 10 0.01546 0.02207 0.02784 0.77% Castro::construct_new_gravity_source() 10 0.01522 0.02232 0.02641 0.73% Castro::hybrid_to_linear_momentum() 62 0.01477 0.01914 0.02326 0.64% Amr::checkPoint() 3 0.007129 0.01632 0.02075 0.57% Castro::initialize_advance() 10 0.0126 0.01643 0.01975 0.55% MultiFab::contains_nan() 20 0.009797 0.01252 0.01602 0.44% MultiFab::Saxpy() 20 0.01064 0.01285 0.01449 0.40% FabArray::setDomainBndry() 251 0.005959 0.009336 0.0138 0.38% Gravity::get_new_grav_vector() 11 0.005115 0.008238 0.01197 0.33% Castro::derive() 187 0.006997 0.009731 0.01098 0.30% Gravity::add_pointmass_to_gravity() 21 0.007306 0.009087 0.01021 0.28% Castro::construct_old_gravity_source() 10 0.004763 0.007627 0.00984 0.27% Castro::fill_hybrid_hydro_source() 30 0.00464 0.005981 0.006858 0.19% Castro::initMFs() 1 0.003839 0.005779 0.00676 0.19% Castro::volWgtSum() 176 0.005283 0.00581 0.00626 0.17% Castro::post_init() 1 0.0008383 0.001917 0.005972 0.16% Gravity::get_old_grav_vector() 10 0.003488 0.004803 0.005633 0.16% Castro::enforce_min_density() 62 0.003992 0.004997 0.005559 0.15% StateData::define() 4 0.003477 0.004833 0.005337 0.15% Castro::swap_state_time_levels() 10 0.002583 0.004462 0.004864 0.13% Castro::initData() 1 0.001835 0.00269 0.002973 0.08% main() 1 0.0009548 0.00115 0.001531 0.04% Castro::buildMetrics() 1 0.0009016 0.001224 0.001398 0.04% Castro::subcycle_advance_ctu() 10 5.276e-05 0.0001284 0.0009824 0.03% Castro::locSquaredSum() 11 0.0004217 0.0005219 0.000616 0.02% Amr::coarseTimeStep() 10 0.0003596 0.0004775 0.0006149 0.02% Amr::InitAmr() 1 0.000313 0.0004427 0.0005816 0.02% Castro::reset_internal_energy(MultiFab) 63 0.0003259 0.0004089 0.0005779 0.02% Castro::clean_state() 62 0.0002562 0.0003181 0.0004023 0.01% StateDataPhysBCFunct::() 251 0.0002085 0.0002582 0.0003162 0.01% StateData::checkPoint() 12 2.536e-05 4.949e-05 0.0003109 0.01% Castro::linear_to_hybrid_momentum() 1 0.0002179 0.0002627 0.0003013 0.01% DistributionMapping::LeastUsedCPUs() 1 1.169e-05 0.0001447 0.0002886 0.01% FabArray::ParallelCopy() 251 0.00015 0.0001836 0.0002506 0.01% FillPatchSingleLevel 251 0.0001486 0.000189 0.0002395 0.01% Castro::Castro() 1 9.347e-05 0.000143 0.0002318 0.01% Castro::finalize_advance() 10 0.0001031 0.0001353 0.0001788 0.00% Castro::computeNewDt() 9 1.078e-05 2.322e-05 0.0001616 0.00% AmrLevel::checkPoint() 3 5.913e-05 7.429e-05 0.0001465 0.00% Castro::construct_new_gravity() 10 3.309e-05 7.388e-05 0.0001346 0.00% Castro::enforce_consistent_e() 1 6.661e-05 9.863e-05 0.000132 0.00% Castro::construct_new_source() 70 7.674e-05 0.0001059 0.000127 0.00% Amr::timeStep() 10 5.287e-05 7.106e-05 0.0001225 0.00% Castro::construct_old_source() 70 6.564e-05 8.454e-05 0.0001122 0.00% FabArrayBase::CPC::define() 2 3.378e-05 6.015e-05 9.889e-05 0.00% Amr::writeSmallPlotFile() 1 2.86e-05 6.89e-05 8.502e-05 0.00% Castro::construct_old_gravity() 10 5.407e-05 6.858e-05 8.385e-05 0.00% Castro::advance() 10 4.574e-05 5.981e-05 7.889e-05 0.00% Castro::check_for_nan() 20 2.8e-05 4.167e-05 6.968e-05 0.00% Amr::FinalizeInit() 1 5.189e-06 1.014e-05 6.841e-05 0.00% Castro::apply_source_to_state() 20 4.636e-05 5.514e-05 6.618e-05 0.00% FabArrayBase::getCPC() 20 3.652e-05 4.746e-05 6.157e-05 0.00% Castro::enforce_speed_limit() 62 4.612e-05 5.273e-05 6.026e-05 0.00% Gravity::swapTimeLevels() 10 1.865e-05 2.557e-05 5.012e-05 0.00% Amr::defBaseLevel() 1 3.372e-05 3.914e-05 4.41e-05 0.00% Castro::construct_new_hybrid_source() 10 1.659e-05 2.83e-05 3.803e-05 0.00% Castro::create_source_corrector() 10 1.344e-05 2.016e-05 3.325e-05 0.00% Castro::construct_old_hybrid_source() 10 1.304e-05 1.901e-05 2.685e-05 0.00% AmrLevel::AmrLevel(dm) 1 1.072e-05 1.463e-05 1.833e-05 0.00% Castro::retry_advance_ctu() 10 8.668e-06 1.214e-05 1.81e-05 0.00% Amr::initSubcycle() 1 1.054e-05 1.533e-05 1.719e-05 0.00% Castro::construct_new_rotation_source() 10 8.695e-06 1.272e-05 1.705e-05 0.00% AmrLevel::checkPointPost() 3 5.266e-06 7.383e-06 1.576e-05 0.00% Castro::construct_old_rotation_source() 10 5.23e-06 8.936e-06 1.411e-05 0.00% Castro::gwstrain() 11 6.724e-06 8.781e-06 1.336e-05 0.00% Castro::FluxRegCrseInit 10 8.583e-06 9.931e-06 1.199e-05 0.00% Gravity::set_mass_offset() 10 7.322e-06 9.736e-06 1.163e-05 0.00% Amr::InitializeInit() 1 3.039e-06 4.08e-06 9.912e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.53e-06 6.859e-06 8.787e-06 0.00% Castro::post_regrid() 1 3.48e-06 4.48e-06 6.353e-06 0.00% Castro::computeInitialDt() 2 3.895e-06 4.857e-06 5.912e-06 0.00% Amr::init() 1 3.164e-06 3.887e-06 5.677e-06 0.00% AmrLevel::checkPointPre() 3 2.644e-06 4.273e-06 5.645e-06 0.00% Castro::FluxRegFineAdd() 10 3.622e-06 4.592e-06 5.601e-06 0.00% Amr::initialInit() 1 1.681e-06 2.355e-06 3.304e-06 0.00% DistributionMapping::Distribute() 1 1.981e-06 2.383e-06 3.139e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.62 3.62 3.62 100.00% Amr::coarseTimeStep() 10 3.058 3.058 3.058 84.48% Amr::timeStep() 10 3.017 3.017 3.017 83.35% Castro::advance() 10 2.932 2.954 2.962 81.83% Castro::subcycle_advance_ctu() 10 2.847 2.865 2.882 79.62% Castro::do_advance_ctu() 10 2.846 2.865 2.882 79.62% Castro::construct_ctu_hydro_source() 10 1.703 2.017 2.275 62.84% Amr::init() 1 0.5287 0.5288 0.529 14.61% Amr::writePlotFile() 2 0.4998 0.4998 0.4998 13.81% FillPatchIterator::Initialize 251 0.1715 0.2265 0.2544 7.03% Castro::initialize_do_advance() 10 0.2049 0.2257 0.2469 6.82% FillPatchSingleLevel 251 0.1256 0.1794 0.2167 5.99% FabArray::ParallelCopy() 251 0.09517 0.1436 0.198 5.47% Castro::clean_state() 62 0.1307 0.1555 0.1769 4.89% Castro::expand_state() 10 0.1351 0.1517 0.1646 4.55% FabArray::ParallelCopy_finish() 251 0.06344 0.1028 0.1587 4.38% Castro::do_old_sources() 10 0.04387 0.06163 0.1318 3.64% Castro::computeTemp() 63 0.0881 0.1032 0.1196 3.30% Castro::do_new_sources() 10 0.06211 0.07652 0.1129 3.12% Castro::initialize_advance() 10 0.06596 0.08867 0.1037 2.86% FabArray::setVal() 164 0.05624 0.07718 0.09429 2.60% Castro::post_timestep() 10 0.05468 0.06327 0.08563 2.37% Castro::estTimeStep() 21 0.0232 0.05153 0.07839 2.17% Castro::reset_internal_energy(MultiFab) 63 0.0546 0.06406 0.07556 2.09% Castro::reset_internal_energy(Fab) 504 0.05426 0.06365 0.07502 2.07% VisMF::Write(FabArray) 11 0.03979 0.04506 0.0612 1.69% StateDataPhysBCFunct::() 251 0.01858 0.03561 0.05445 1.50% StateData::FillBoundary(geom) 20 0.01836 0.03535 0.05418 1.50% FabArray::ParallelCopy_nowait() 251 0.03105 0.04064 0.05273 1.46% Amr::checkPoint() 3 0.04904 0.04922 0.04924 1.36% AmrLevel::checkPoint() 3 0.02846 0.03288 0.0419 1.16% StateData::checkPoint() 12 0.02839 0.03281 0.04175 1.15% Amr::initialInit() 1 0.04068 0.04075 0.04088 1.13% Castro::normalize_species() 62 0.02476 0.02977 0.03454 0.95% Castro::finalize_do_advance() 10 0.001097 0.02331 0.03177 0.88% Castro::construct_new_source() 70 0.01838 0.02639 0.03093 0.85% Castro::volWgtSum() 176 0.01916 0.0252 0.02829 0.78% Amr::InitializeInit() 1 0.01721 0.02517 0.02817 0.78% Amr::defBaseLevel() 1 0.0172 0.02517 0.02817 0.78% Castro::construct_new_gravity_source() 10 0.01522 0.02232 0.02641 0.73% Amr::FinalizeInit() 1 0.01253 0.01558 0.02367 0.65% Castro::hybrid_to_linear_momentum() 62 0.01477 0.01914 0.02326 0.64% Castro::derive() 187 0.01455 0.02017 0.02302 0.64% Gravity::get_new_grav_vector() 11 0.009353 0.01445 0.01959 0.54% Castro::construct_new_gravity() 10 0.008953 0.01339 0.01855 0.51% Castro::check_for_nan() 20 0.009828 0.01256 0.01607 0.44% MultiFab::contains_nan() 20 0.009797 0.01252 0.01602 0.44% Castro::apply_source_to_state() 20 0.01069 0.01291 0.01454 0.40% MultiFab::Saxpy() 20 0.01064 0.01285 0.01449 0.40% FabArray::setDomainBndry() 251 0.005959 0.009336 0.0138 0.38% Castro::computeInitialDt() 2 0.002459 0.005492 0.01359 0.38% Castro::construct_old_source() 70 0.006464 0.009797 0.01225 0.34% Castro::construct_old_gravity() 10 0.008301 0.01073 0.01223 0.34% Castro::Castro() 1 0.006024 0.01022 0.01202 0.33% Gravity::get_old_grav_vector() 10 0.007789 0.0101 0.01153 0.32% Castro::initData() 1 0.007351 0.009908 0.0107 0.30% Gravity::add_pointmass_to_gravity() 21 0.007306 0.009087 0.01021 0.28% Castro::construct_old_gravity_source() 10 0.004763 0.007627 0.00984 0.27% Castro::post_init() 1 0.007999 0.008341 0.009507 0.26% Castro::computeNewDt() 9 0.009264 0.009374 0.009459 0.26% Castro::fill_hybrid_hydro_source() 30 0.00464 0.005981 0.006858 0.19% Castro::initMFs() 1 0.003839 0.005779 0.00676 0.19% Castro::enforce_min_density() 62 0.003992 0.004997 0.005559 0.15% AmrLevel::AmrLevel(dm) 1 0.003488 0.004847 0.005352 0.15% StateData::define() 4 0.003477 0.004833 0.005337 0.15% Castro::swap_state_time_levels() 10 0.002583 0.004462 0.004864 0.13% Castro::construct_new_hybrid_source() 10 0.00305 0.003953 0.004602 0.13% Castro::post_regrid() 1 0.001748 0.002915 0.003255 0.09% Castro::construct_old_hybrid_source() 10 0.001628 0.002076 0.002455 0.07% Castro::buildMetrics() 1 0.0009792 0.001375 0.001594 0.04% Castro::locSquaredSum() 11 0.001089 0.001307 0.001419 0.04% Amr::InitAmr() 1 0.0003235 0.0004581 0.0005967 0.02% Castro::linear_to_hybrid_momentum() 1 0.0002179 0.0002627 0.0003013 0.01% DistributionMapping::SFCProcessorMapDoIt() 1 1.928e-05 0.0001539 0.0002994 0.01% DistributionMapping::LeastUsedCPUs() 1 1.169e-05 0.0001447 0.0002886 0.01% Castro::finalize_advance() 10 0.0001177 0.0001498 0.0001949 0.01% FabArrayBase::getCPC() 20 7.609e-05 0.0001076 0.000153 0.00% Castro::enforce_consistent_e() 1 6.661e-05 9.863e-05 0.000132 0.00% FabArrayBase::CPC::define() 2 3.378e-05 6.015e-05 9.889e-05 0.00% Amr::writeSmallPlotFile() 1 2.86e-05 6.89e-05 8.502e-05 0.00% Castro::enforce_speed_limit() 62 4.612e-05 5.273e-05 6.026e-05 0.00% Gravity::swapTimeLevels() 10 1.865e-05 2.557e-05 5.012e-05 0.00% Castro::create_source_corrector() 10 1.344e-05 2.016e-05 3.325e-05 0.00% Castro::retry_advance_ctu() 10 8.668e-06 1.214e-05 1.81e-05 0.00% Amr::initSubcycle() 1 1.054e-05 1.533e-05 1.719e-05 0.00% Castro::construct_new_rotation_source() 10 8.695e-06 1.272e-05 1.705e-05 0.00% AmrLevel::checkPointPost() 3 5.266e-06 7.383e-06 1.576e-05 0.00% Castro::construct_old_rotation_source() 10 5.23e-06 8.936e-06 1.411e-05 0.00% Castro::gwstrain() 11 6.724e-06 8.781e-06 1.336e-05 0.00% Castro::FluxRegCrseInit 10 8.583e-06 9.931e-06 1.199e-05 0.00% Gravity::set_mass_offset() 10 7.322e-06 9.736e-06 1.163e-05 0.00% AmrLevel::checkPointPre() 3 2.644e-06 4.273e-06 5.645e-06 0.00% Castro::FluxRegFineAdd() 10 3.622e-06 4.592e-06 5.601e-06 0.00% DistributionMapping::Distribute() 1 1.981e-06 2.383e-06 3.139e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-39-g50466d11e7b2) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-39-g50466d11e7b2) initialized Starting run at 23:16:20 UTC on 2022-04-30. Successfully read inputs file ... Castro git describe: 22.04-49-g7653ce36f AMReX git describe: 22.04-39-g50466d11e Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 37.90162142 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.038510768 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.008520611 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.28883035 Castro::do_new_sources() time = 0.009557148 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.6873385461 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.391155931 [STEP 6] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006984313 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.290116621 Castro::do_new_sources() time = 0.009757839 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7010644491 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.385107735 [STEP 7] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007971349 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.282244318 Castro::do_new_sources() time = 0.009396035 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7114806993 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.378865898 [STEP 8] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005818149 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.269900638 Castro::do_new_sources() time = 0.009318921 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7397007143 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.363738882 [STEP 9] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007148214 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.266987137 Castro::do_new_sources() time = 0.010442109 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7428182572 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.452219819 [STEP 10] FAB kilobyte spread across MPI nodes: [50421 ... 50421] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.238712481 seconds Ending run at 23:16:22 UTC on 2022-04-30. Run time = 2.252606197 Run time without initialization = 2.213656811 Average number of zones advanced per microsecond: 0.592 Average number of zones advanced per microsecond per rank: 0.037 TinyProfiler total time across processes [min...avg...max]: 2.252 ... 2.252 ... 2.253 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7542 1.1701 1.4135 62.75% Castro::do_advance_ctu() 5 0.01814 0.2585 0.6841 30.37% Amr::writePlotFile() 1 0.231 0.2335 0.2342 10.39% FabArray::ParallelCopy_finish() 116 0.03011 0.05927 0.1202 5.33% Castro::post_timestep() 5 0.008373 0.0232 0.11 4.88% Amr::coarseTimeStep() 5 0.000359 0.08481 0.09051 4.02% Castro::do_old_sources() 5 8.745e-05 0.01051 0.0549 2.44% FabArray::setVal() 80 0.03906 0.04669 0.05263 2.34% Castro::estTimeStep() 10 0.01108 0.02607 0.04482 1.99% StateData::FillBoundary(geom) 10 0.01183 0.0228 0.04268 1.89% Castro::reset_internal_energy(Fab) 240 0.02565 0.03365 0.04173 1.85% FabArray::ParallelCopy_nowait() 116 0.01784 0.02311 0.03198 1.42% Castro::do_new_sources() 5 7.241e-05 0.00723 0.02806 1.25% FillPatchIterator::Initialize 116 0.01903 0.02329 0.0266 1.18% Castro::computeTemp() 30 0.01589 0.02057 0.02469 1.10% Castro::normalize_species() 30 0.0122 0.0164 0.02035 0.90% VisMF::Read() 3 0.01736 0.01907 0.01975 0.88% Castro::finalize_do_advance() 5 0.007569 0.01436 0.01971 0.87% Castro::construct_new_gravity_source() 5 0.01327 0.01545 0.01873 0.83% Castro::expand_state() 5 0.007748 0.01343 0.01773 0.79% Castro::initialize_do_advance() 5 0.01145 0.01485 0.01748 0.78% Castro::hybrid_to_linear_momentum() 30 0.008947 0.01141 0.01537 0.68% Castro::initialize_advance() 5 0.008445 0.0116 0.01442 0.64% MultiFab::contains_nan() 10 0.005949 0.008671 0.01218 0.54% MultiFab::Saxpy() 10 0.00626 0.008242 0.009699 0.43% VisMF::Write(FabArray) 1 0.005877 0.006579 0.009046 0.40% Gravity::get_new_grav_vector() 5 0.003257 0.005587 0.008673 0.39% Amr::restart() 1 0.008258 0.008347 0.008484 0.38% Castro::derive() 86 0.00479 0.006388 0.008434 0.37% FabArray::setDomainBndry() 116 0.003046 0.005209 0.007105 0.32% Castro::construct_old_gravity_source() 5 0.00315 0.005412 0.006867 0.30% Gravity::add_pointmass_to_gravity() 10 0.003745 0.005112 0.006231 0.28% Castro::initMFs() 1 0.004497 0.004876 0.00527 0.23% Castro::fill_hybrid_hydro_source() 15 0.002634 0.003694 0.004564 0.20% Castro::swap_state_time_levels() 5 0.00426 0.00438 0.004495 0.20% Castro::post_restart() 1 6.495e-05 0.001021 0.004286 0.19% Gravity::get_old_grav_vector() 5 0.002458 0.003176 0.004241 0.19% StateData::restartDoit() 4 0.00288 0.003855 0.004116 0.18% Castro::enforce_min_density() 30 0.00242 0.003001 0.003558 0.16% Castro::volWgtSum() 80 0.002499 0.00284 0.003253 0.14% main() 1 0.001348 0.002081 0.002443 0.11% Castro::finalize_advance() 5 0.0002142 0.001156 0.001609 0.07% Castro::subcycle_advance_ctu() 5 2.957e-05 7.754e-05 0.0006594 0.03% Castro::buildMetrics() 1 0.0002016 0.000373 0.0005443 0.02% Amr::InitAmr() 1 0.0002887 0.0004083 0.0004853 0.02% Castro::reset_internal_energy(MultiFab) 30 0.0001361 0.0002178 0.0004245 0.02% Castro::locSquaredSum() 6 0.0002232 0.0003203 0.0004175 0.02% Castro::clean_state() 30 0.0001531 0.0002303 0.0002998 0.01% AmrLevel::restart() 1 0.000139 0.0002348 0.0002637 0.01% StateDataPhysBCFunct::() 116 9.939e-05 0.0001373 0.0001933 0.01% FillPatchSingleLevel 116 7.381e-05 0.0001069 0.0001499 0.01% FabArray::ParallelCopy() 116 6.754e-05 9.844e-05 0.00013 0.01% Castro::construct_new_gravity() 5 2.107e-05 5.515e-05 9.765e-05 0.00% Castro::construct_new_source() 35 4.645e-05 6.564e-05 9.569e-05 0.00% Castro::computeNewDt() 5 5.056e-06 1.233e-05 9.443e-05 0.00% Castro::construct_old_source() 35 3.969e-05 5.389e-05 7.701e-05 0.00% Castro::check_for_nan() 10 1.647e-05 3.395e-05 7.512e-05 0.00% FabArrayBase::CPC::define() 2 3.899e-05 5.405e-05 7.055e-05 0.00% Amr::timeStep() 5 2.888e-05 4.123e-05 6.675e-05 0.00% Castro::construct_old_gravity() 5 2.606e-05 4.405e-05 6.333e-05 0.00% Amr::writeSmallPlotFile() 1 3.255e-05 3.823e-05 6.182e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.027e-06 2.222e-05 5.331e-05 0.00% Castro::advance() 5 2.681e-05 3.437e-05 4.522e-05 0.00% FabArrayBase::getCPC() 10 2.152e-05 2.722e-05 4.233e-05 0.00% Castro::apply_source_to_state() 10 2.362e-05 2.878e-05 3.949e-05 0.00% Castro::create_source_corrector() 5 8.587e-06 1.631e-05 3.45e-05 0.00% Castro::construct_new_hybrid_source() 5 1.114e-05 1.923e-05 3.247e-05 0.00% Castro::enforce_speed_limit() 30 1.25e-05 1.87e-05 2.279e-05 0.00% Gravity::swapTimeLevels() 5 1.052e-05 1.519e-05 2.205e-05 0.00% Amr::initSubcycle() 1 9.609e-06 1.434e-05 1.605e-05 0.00% Castro::construct_old_hybrid_source() 5 9.781e-06 1.203e-05 1.576e-05 0.00% Castro::retry_advance_ctu() 5 5.193e-06 7.803e-06 1.424e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 6.039e-06 7.622e-06 1.227e-05 0.00% Castro::construct_new_rotation_source() 5 4.973e-06 7.178e-06 1.092e-05 0.00% Castro::construct_old_rotation_source() 5 4.061e-06 6.65e-06 1.038e-05 0.00% Castro::FluxRegCrseInit 5 4.087e-06 6.035e-06 9.994e-06 0.00% Gravity::set_mass_offset() 6 4.124e-06 5.635e-06 9.705e-06 0.00% Castro::gwstrain() 5 4.385e-06 5.685e-06 7.823e-06 0.00% Amr::init() 1 1.093e-06 1.546e-06 4.186e-06 0.00% Castro::FluxRegFineAdd() 5 2.226e-06 2.657e-06 4.046e-06 0.00% DistributionMapping::Distribute() 1 1.697e-06 2.444e-06 3.101e-06 0.00% AmrLevel::AmrLevel() 1 1.224e-06 1.736e-06 2.193e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 2.252 2.252 2.253 100.00% Amr::coarseTimeStep() 5 1.971 1.971 1.971 87.51% Amr::timeStep() 5 1.875 1.88 1.965 87.23% Castro::advance() 5 1.824 1.831 1.837 81.53% Castro::subcycle_advance_ctu() 5 1.765 1.771 1.781 79.04% Castro::do_advance_ctu() 5 1.765 1.771 1.78 79.04% Castro::construct_ctu_hydro_source() 5 0.7542 1.17 1.413 62.75% Amr::writePlotFile() 1 0.24 0.24 0.24 10.66% FillPatchIterator::Initialize 116 0.09932 0.1341 0.1723 7.65% FillPatchSingleLevel 116 0.06876 0.1056 0.1501 6.67% Castro::initialize_do_advance() 5 0.1195 0.1327 0.1492 6.62% FabArray::ParallelCopy() 116 0.04845 0.08256 0.1381 6.13% Castro::post_timestep() 5 0.03828 0.0491 0.1338 5.94% FabArray::ParallelCopy_finish() 116 0.03011 0.05927 0.1202 5.33% Castro::clean_state() 30 0.06593 0.08551 0.1026 4.56% Castro::expand_state() 5 0.08118 0.09065 0.101 4.48% Castro::do_old_sources() 5 0.02235 0.03849 0.0806 3.58% Castro::do_new_sources() 5 0.03826 0.04914 0.07041 3.13% Castro::initialize_advance() 5 0.04435 0.05873 0.06771 3.01% Castro::computeTemp() 30 0.04168 0.05445 0.06675 2.96% FabArray::setVal() 80 0.03906 0.04669 0.05263 2.34% Castro::estTimeStep() 10 0.01108 0.02607 0.04482 1.99% StateDataPhysBCFunct::() 116 0.01193 0.02294 0.04283 1.90% StateData::FillBoundary(geom) 10 0.01183 0.0228 0.04268 1.89% Castro::reset_internal_energy(MultiFab) 30 0.02579 0.03387 0.04206 1.87% Castro::reset_internal_energy(Fab) 240 0.02565 0.03365 0.04173 1.85% Amr::init() 1 0.03829 0.03839 0.03854 1.71% Amr::restart() 1 0.03829 0.03839 0.03854 1.71% FabArray::ParallelCopy_nowait() 116 0.01791 0.0232 0.03207 1.42% AmrLevel::restart() 1 0.02052 0.0233 0.02418 1.07% StateData::restartDoit() 4 0.02032 0.02303 0.02391 1.06% Castro::construct_new_source() 35 0.01515 0.01796 0.02194 0.97% Castro::normalize_species() 30 0.0122 0.0164 0.02035 0.90% VisMF::Read() 3 0.01736 0.01907 0.01975 0.88% Castro::finalize_do_advance() 5 0.007569 0.01436 0.01971 0.87% Castro::construct_new_gravity_source() 5 0.01327 0.01545 0.01873 0.83% Castro::volWgtSum() 80 0.0117 0.01495 0.01752 0.78% Castro::derive() 86 0.01005 0.01292 0.01591 0.71% Castro::hybrid_to_linear_momentum() 30 0.008947 0.01141 0.01537 0.68% Castro::construct_new_gravity() 5 0.005841 0.009635 0.01433 0.64% Gravity::get_new_grav_vector() 5 0.005527 0.009035 0.01334 0.59% Castro::check_for_nan() 10 0.005965 0.008705 0.01224 0.54% MultiFab::contains_nan() 10 0.005949 0.008671 0.01218 0.54% Castro::apply_source_to_state() 10 0.006284 0.00827 0.009732 0.43% MultiFab::Saxpy() 10 0.00626 0.008242 0.009699 0.43% VisMF::Write(FabArray) 1 0.005877 0.006579 0.009046 0.40% Castro::construct_old_gravity() 5 0.005161 0.006866 0.008863 0.39% Castro::construct_old_source() 35 0.004147 0.006755 0.008686 0.39% Gravity::get_old_grav_vector() 5 0.004793 0.006429 0.008291 0.37% FabArray::setDomainBndry() 116 0.003046 0.005209 0.007105 0.32% Castro::construct_old_gravity_source() 5 0.00315 0.005412 0.006867 0.30% Gravity::add_pointmass_to_gravity() 10 0.003745 0.005112 0.006231 0.28% Castro::computeNewDt() 5 0.005853 0.006024 0.006083 0.27% Castro::initMFs() 1 0.004497 0.004876 0.00527 0.23% Castro::fill_hybrid_hydro_source() 15 0.002634 0.003694 0.004564 0.20% Castro::swap_state_time_levels() 5 0.00426 0.00438 0.004495 0.20% Castro::post_restart() 1 0.000383 0.001317 0.004493 0.20% Castro::enforce_min_density() 30 0.00242 0.003001 0.003558 0.16% Castro::construct_new_hybrid_source() 5 0.001754 0.002443 0.003124 0.14% Castro::locSquaredSum() 6 0.0007783 0.001132 0.001891 0.08% Castro::construct_old_hybrid_source() 5 0.0009013 0.001282 0.001752 0.08% Castro::finalize_advance() 5 0.0002213 0.001164 0.001615 0.07% Castro::buildMetrics() 1 0.0002876 0.0005523 0.0008734 0.04% Amr::InitAmr() 1 0.0002984 0.0004226 0.0005005 0.02% FabArrayBase::getCPC() 10 6.123e-05 8.127e-05 0.000111 0.00% FabArrayBase::CPC::define() 2 3.899e-05 5.405e-05 7.055e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 1.735e-05 3.229e-05 6.449e-05 0.00% Amr::writeSmallPlotFile() 1 3.255e-05 3.823e-05 6.182e-05 0.00% DistributionMapping::LeastUsedCPUs() 1 9.027e-06 2.222e-05 5.331e-05 0.00% Castro::create_source_corrector() 5 8.587e-06 1.631e-05 3.45e-05 0.00% Castro::enforce_speed_limit() 30 1.25e-05 1.87e-05 2.279e-05 0.00% Gravity::swapTimeLevels() 5 1.052e-05 1.519e-05 2.205e-05 0.00% Amr::initSubcycle() 1 9.609e-06 1.434e-05 1.605e-05 0.00% Castro::retry_advance_ctu() 5 5.193e-06 7.803e-06 1.424e-05 0.00% Castro::construct_new_rotation_source() 5 4.973e-06 7.178e-06 1.092e-05 0.00% Castro::construct_old_rotation_source() 5 4.061e-06 6.65e-06 1.038e-05 0.00% Castro::FluxRegCrseInit 5 4.087e-06 6.035e-06 9.994e-06 0.00% Gravity::set_mass_offset() 6 4.124e-06 5.635e-06 9.705e-06 0.00% Castro::gwstrain() 5 4.385e-06 5.685e-06 7.823e-06 0.00% Castro::FluxRegFineAdd() 5 2.226e-06 2.657e-06 4.046e-06 0.00% DistributionMapping::Distribute() 1 1.697e-06 2.444e-06 3.101e-06 0.00% AmrLevel::AmrLevel() 1 1.224e-06 1.736e-06 2.193e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-39-g50466d11e7b2) finalized