MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-29-g329f81b889a6) initialized Starting run at 06:46:37 UTC on 2022-04-26. Successfully read inputs file ... Castro git describe: 22.04-28-g7e86dbe56 AMReX git describe: 22.04-29-g329f81b88 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 Successfully read inputs file ... Castro::numpts_1d at level 0 is 118 Setting the gravity type to ConstantGrav Warning: the following castro.* parameters are ignored castro.center = 0.0 0.0 0.0 Initializing the data at level 0 Done initializing the level 0 data ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 Moment of inertia = 2826.515708 TIME= 0 MASS = 0.5935240411 TIME= 0 XMOM = 1.110223025e-16 TIME= 0 YMOM = -1.665334537e-16 TIME= 0 ZMOM = 0 TIME= 0 ANG MOM X = -6.938893904e-18 TIME= 0 ANG MOM Y = -5.551115123e-17 TIME= 0 ANG MOM Z = 4.289006454 TIME= 0 HYB MOM R = 0 TIME= 0 HYB MOM L = 4.289006454 TIME= 0 HYB MOM P = 0 TIME= 0 RHO*e = 0.7105397598 TIME= 0 RHO*K = 13.47431117 TIME= 0 RHO*E = 14.18485093 TIME= 0 RHO*PHI = 0 TIME= 0 TOTAL ENERGY= 14.18485093 INITIAL GRIDS Level 0 16 grids 262144 cells 100 % of domain smallest grid: 32 x 32 x 16 biggest grid: 32 x 32 x 16 CHECKPOINT: file = rotating_torus-restart_chk00000 checkPoint() time = 0.017319716 secs. PLOTFILE: file = rotating_torus-restart_plt00000 Write plotfile time = 0.176606971 seconds ...estimated hydro-limited timestep at level 0: 0.003340435764 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003340435764 [Level 0 step 1] ADVANCE with dt = 0.0003340435764  Beginning subcycle 1 starting at time 0 with dt = 0.0003340435764 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007584189 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.268891762 Castro::do_new_sources() time = 0.008903887 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7305213471 [Level 0 step 1] Advanced 262144 cells Moment of inertia = 2826.373585 Moment of inertia / initial moment of inertia = 0.9999497183 TIME= 0.0003340435764 MASS = 0.5935240411 TIME= 0.0003340435764 XMOM = -3.330669074e-16 TIME= 0.0003340435764 YMOM = -3.497202528e-15 TIME= 0.0003340435764 ZMOM = -6.350499824e-13 TIME= 0.0003340435764 ANG MOM X = 1.42247325e-16 TIME= 0.0003340435764 ANG MOM Y = 2.775557562e-17 TIME= 0.0003340435764 ANG MOM Z = 4.289006454 TIME= 0.0003340435764 HYB MOM R = 0.001323091462 TIME= 0.0003340435764 HYB MOM L = 4.289006454 TIME= 0.0003340435764 HYB MOM P = -6.350499824e-13 TIME= 0.0003340435764 RHO*e = 0.711807891 TIME= 0.0003340435764 RHO*K = 13.47504927 TIME= 0.0003340435764 RHO*E = 14.18685716 TIME= 0.0003340435764 RHO*PHI = 0 TIME= 0.0003340435764 TOTAL ENERGY= 14.18685716 [STEP 1] Coarse TimeStep time: 0.367201395 [STEP 1] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 1 TIME = 0.0003340435764 DT = 0.0003340435764 ...estimated hydro-limited timestep at level 0: 0.003354140473 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003354140473 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003354140473 ... but limiting to: 0.0003507457552 = 1.05 * 0.0003340435764 [Level 0 step 2] ADVANCE with dt = 0.0003507457552  Beginning subcycle 1 starting at time 0.0003340435764 with dt = 0.0003507457552 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007408893 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.264956586 Castro::do_new_sources() time = 0.00878891 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.761117729 [Level 0 step 2] Advanced 262144 cells Moment of inertia = 2826.287536 Moment of inertia / initial moment of inertia = 0.9999192746 TIME= 0.0006847893316 MASS = 0.5935240411 TIME= 0.0006847893316 XMOM = -1.221245327e-15 TIME= 0.0006847893316 YMOM = 9.159339953e-15 TIME= 0.0006847893316 ZMOM = -1.965399313e-12 TIME= 0.0006847893316 ANG MOM X = 1.908195824e-16 TIME= 0.0006847893316 ANG MOM Y = -9.714451465e-17 TIME= 0.0006847893316 ANG MOM Z = 4.289006454 TIME= 0.0006847893316 HYB MOM R = 0.002712341525 TIME= 0.0006847893316 HYB MOM L = 4.289006454 TIME= 0.0006847893316 HYB MOM P = -1.965399313e-12 TIME= 0.0006847893316 RHO*e = 0.712189286 TIME= 0.0006847893316 RHO*K = 13.47551885 TIME= 0.0006847893316 RHO*E = 14.18770813 TIME= 0.0006847893316 RHO*PHI = 0 TIME= 0.0006847893316 TOTAL ENERGY= 14.18770813 [STEP 2] Coarse TimeStep time: 0.357615114 [STEP 2] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 2 TIME = 0.0006847893316 DT = 0.0003507457552 ...estimated hydro-limited timestep at level 0: 0.003373674841 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.003373674841 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.003373674841 ... but limiting to: 0.000368283043 = 1.05 * 0.0003507457552 [Level 0 step 3] ADVANCE with dt = 0.000368283043  Beginning subcycle 1 starting at time 0.0006847893316 with dt = 0.000368283043 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004800223 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.21340522 Castro::do_new_sources() time = 0.009271745 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9036559599 [Level 0 step 3] Advanced 262144 cells Moment of inertia = 2826.201161 Moment of inertia / initial moment of inertia = 0.9998887157 TIME= 0.001053072375 MASS = 0.5935240411 TIME= 0.001053072375 XMOM = -1.665334537e-15 TIME= 0.001053072375 YMOM = 3.441691376e-15 TIME= 0.001053072375 ZMOM = -3.356804404e-12 TIME= 0.001053072375 ANG MOM X = 1.040834086e-16 TIME= 0.001053072375 ANG MOM Y = 8.326672685e-17 TIME= 0.001053072375 ANG MOM Z = 4.289006454 TIME= 0.001053072375 HYB MOM R = 0.00417099308 TIME= 0.001053072375 HYB MOM L = 4.289006454 TIME= 0.001053072375 HYB MOM P = -3.356804404e-12 TIME= 0.001053072375 RHO*e = 0.7125668076 TIME= 0.001053072375 RHO*K = 13.47601781 TIME= 0.001053072375 RHO*E = 14.18858462 TIME= 0.001053072375 RHO*PHI = 0 TIME= 0.001053072375 TOTAL ENERGY= 14.18858462 [STEP 3] Coarse TimeStep time: 0.299908405 [STEP 3] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 3 TIME = 0.001053072375 DT = 0.000368283043 ...estimated hydro-limited timestep at level 0: 0.00339481947 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.00339481947 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.00339481947 ... but limiting to: 0.0003866971951 = 1.05 * 0.000368283043 [Level 0 step 4] ADVANCE with dt = 0.0003866971951  Beginning subcycle 1 starting at time 0.001053072375 with dt = 0.0003866971951 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005788523 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.201280532 Castro::do_new_sources() time = 0.00939589 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9761937628 [Level 0 step 4] Advanced 262144 cells Moment of inertia = 2826.122103 Moment of inertia / initial moment of inertia = 0.9998607457 TIME= 0.00143976957 MASS = 0.5935240411 TIME= 0.00143976957 XMOM = 8.881784197e-16 TIME= 0.00143976957 YMOM = 5.440092821e-15 TIME= 0.00143976957 ZMOM = -4.815166034e-12 TIME= 0.00143976957 ANG MOM X = 6.938893904e-17 TIME= 0.00143976957 ANG MOM Y = 1.387778781e-17 TIME= 0.00143976957 ANG MOM Z = 4.289006454 TIME= 0.00143976957 HYB MOM R = 0.005702512117 TIME= 0.00143976957 HYB MOM L = 4.289006454 TIME= 0.00143976957 HYB MOM P = -4.815166034e-12 TIME= 0.00143976957 RHO*e = 0.7129260318 TIME= 0.00143976957 RHO*K = 13.47651236 TIME= 0.00143976957 RHO*E = 14.18943839 TIME= 0.00143976957 RHO*PHI = 0 TIME= 0.00143976957 TOTAL ENERGY= 14.18943839 [STEP 4] Coarse TimeStep time: 0.277633545 [STEP 4] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 4 TIME = 0.00143976957 DT = 0.0003866971951 ...estimated hydro-limited timestep at level 0: 0.002981054165 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002981054165 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002981054165 ... but limiting to: 0.0004060320549 = 1.05 * 0.0003866971951 [Level 0 step 5] ADVANCE with dt = 0.0004060320549  Beginning subcycle 1 starting at time 0.00143976957 with dt = 0.0004060320549 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006745189 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.168640914 Castro::do_new_sources() time = 0.009293486 ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.11328552 [Level 0 step 5] Advanced 262144 cells Moment of inertia = 2826.060054 Moment of inertia / initial moment of inertia = 0.9998387932 TIME= 0.001845801625 MASS = 0.5935240411 TIME= 0.001845801625 XMOM = 8.881784197e-16 TIME= 0.001845801625 YMOM = 7.827072324e-15 TIME= 0.001845801625 ZMOM = -6.346287035e-12 TIME= 0.001845801625 ANG MOM X = -6.938893904e-18 TIME= 0.001845801625 ANG MOM Y = 1.873501354e-16 TIME= 0.001845801625 ANG MOM Z = 4.289006454 TIME= 0.001845801625 HYB MOM R = 0.007310517316 TIME= 0.001845801625 HYB MOM L = 4.289006454 TIME= 0.001845801625 HYB MOM P = -6.346287035e-12 TIME= 0.001845801625 RHO*e = 0.7132495392 TIME= 0.001845801625 RHO*K = 13.47695837 TIME= 0.001845801625 RHO*E = 14.19020791 TIME= 0.001845801625 RHO*PHI = 0 TIME= 0.001845801625 TOTAL ENERGY= 14.19020791 [STEP 5] Coarse TimeStep time: 0.244038957 [STEP 5] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 5 TIME = 0.001845801625 DT = 0.0004060320549 CHECKPOINT: file = rotating_torus-restart_chk00005 checkPoint() time = 0.01692469 secs. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006803666 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.16791459 Castro::do_new_sources() time = 0.009063256 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.085776631 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9998235867 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.24921784 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00419376 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.153544241 Castro::do_new_sources() time = 0.007376865 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.303265899 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.999813966 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.208861645 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.003913693 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.154266755 Castro::do_new_sources() time = 0.00518963 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.328372638 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9998089305 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.204377314 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004109932 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.154817849 Castro::do_new_sources() time = 0.005112905 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.326426347 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.999811601 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.204558216 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.004046585 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.154435891 Castro::do_new_sources() time = 0.005115425 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.327114617 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9998225119 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.204417746 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 CHECKPOINT: file = rotating_torus-restart_chk00010 checkPoint() time = 0.013692572 secs. PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.182621103 seconds Ending run at 06:46:40 UTC on 2022-04-26. Run time = 3.068514199 Run time without initialization = 2.83346859 Average number of zones advanced per microsecond: 0.925 Average number of zones advanced per microsecond per rank: 0.058 TinyProfiler total time across processes [min...avg...max]: 3.068 ... 3.068 ... 3.069 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 10 1.5889 1.7487 1.9113 62.29% Castro::do_advance_ctu() 10 0.02947 0.1887 0.3493 11.38% Amr::writePlotFile() 2 0.3408 0.3474 0.3492 11.38% FabArray::ParallelCopy_finish() 251 0.06646 0.09093 0.1416 4.62% FabArray::setVal() 164 0.07648 0.08899 0.09747 3.18% Castro::do_old_sources() 10 0.0001676 0.01456 0.06883 2.24% Castro::reset_internal_energy() 63 0.0534 0.05743 0.06299 2.05% VisMF::Write(FabArray) 11 0.04163 0.04681 0.0598 1.95% FabArray::ParallelCopy_nowait() 251 0.03255 0.04066 0.0505 1.65% Castro::estTimeStep() 21 0.01808 0.03046 0.04846 1.58% StateData::FillBoundary(geom) 20 0.01613 0.02994 0.04359 1.42% FillPatchIterator::Initialize 251 0.03123 0.03672 0.04195 1.37% Castro::computeTemp() 63 0.03282 0.03545 0.03934 1.28% Castro::post_timestep() 10 0.007237 0.01744 0.03655 1.19% Castro::finalize_do_advance() 10 0.001952 0.02322 0.03015 0.98% Castro::normalize_species() 62 0.02536 0.02736 0.03006 0.98% Castro::expand_state() 10 0.0153 0.02264 0.02984 0.97% Castro::initialize_do_advance() 10 0.02057 0.02488 0.02624 0.86% Castro::construct_new_gravity_source() 10 0.02062 0.02213 0.02328 0.76% Castro::initialize_advance() 10 0.01341 0.0169 0.02176 0.71% Castro::hybrid_to_linear_momentum() 62 0.01676 0.01828 0.02095 0.68% Amr::checkPoint() 3 0.00835 0.01519 0.0191 0.62% Castro::do_new_sources() 10 0.0001604 0.005704 0.01854 0.60% MultiFab::contains_nan() 20 0.009638 0.01216 0.01775 0.58% MultiFab::Saxpy() 20 0.01138 0.01408 0.01631 0.53% FabArray::setDomainBndry() 251 0.005352 0.01002 0.01525 0.50% Gravity::get_new_grav_vector() 11 0.007077 0.009308 0.01123 0.37% Castro::derive() 187 0.008175 0.009317 0.01105 0.36% Gravity::add_pointmass_to_gravity() 21 0.007691 0.008549 0.009352 0.30% Castro::construct_old_gravity_source() 10 0.006353 0.007398 0.008487 0.28% Castro::fill_hybrid_hydro_source() 30 0.005181 0.006297 0.007289 0.24% Amr::defBaseLevel() 1 0.004452 0.006379 0.006761 0.22% Gravity::get_old_grav_vector() 10 0.003832 0.005676 0.006467 0.21% Castro::volWgtSum() 176 0.005175 0.005467 0.005693 0.19% Castro::post_init() 1 0.0007648 0.001442 0.005337 0.17% Castro::enforce_min_density() 62 0.004159 0.004645 0.005053 0.16% Castro::swap_state_time_levels() 10 0.003979 0.004327 0.004858 0.16% StateData::define() 4 0.003216 0.00447 0.004695 0.15% Castro::initData() 1 0.001803 0.002487 0.00267 0.09% main() 1 0.0008251 0.001096 0.001876 0.06% Castro::subcycle_advance_ctu() 10 5.276e-05 0.0001402 0.001206 0.04% Castro::clean_state() 62 0.0002316 0.0003056 0.0006706 0.02% Amr::InitAmr() 1 0.0002624 0.0004124 0.0005715 0.02% Castro::locSquaredSum() 11 0.0003946 0.0004558 0.000555 0.02% Amr::coarseTimeStep() 10 0.0003385 0.000405 0.0005384 0.02% DistributionMapping::LeastUsedCPUs() 1 1.035e-05 0.0001855 0.000384 0.01% StateDataPhysBCFunct::() 251 0.0002021 0.0002399 0.0003295 0.01% Castro::linear_to_hybrid_momentum() 1 0.000214 0.0002495 0.0003031 0.01% StateData::checkPoint() 12 2.72e-05 4.721e-05 0.0002975 0.01% Castro::computeNewDt() 9 7.291e-06 2.133e-05 0.0002096 0.01% FabArray::ParallelCopy() 251 0.0001515 0.0001774 0.0002069 0.01% FillPatchSingleLevel 251 0.0001547 0.0001749 0.0001991 0.01% Castro::enforce_consistent_e() 1 5.987e-05 0.0001037 0.0001926 0.01% Castro::construct_new_source() 70 8.505e-05 0.0001298 0.0001655 0.01% Castro::finalize_advance() 10 9.825e-05 0.0001165 0.0001453 0.00% AmrLevel::checkPoint() 3 5.697e-05 7.393e-05 0.000144 0.00% Amr::timeStep() 10 5.272e-05 6.66e-05 0.0001123 0.00% Castro::construct_old_source() 70 6.888e-05 9.026e-05 0.0001107 0.00% Castro::construct_new_gravity() 10 3.961e-05 7.163e-05 0.0001071 0.00% Castro::construct_old_gravity() 10 6.438e-05 8.418e-05 0.0001056 0.00% Castro::apply_source_to_state() 20 5.276e-05 7.067e-05 9.33e-05 0.00% FabArrayBase::CPC::define() 2 2.955e-05 4.846e-05 8.749e-05 0.00% Castro::enforce_speed_limit() 62 4.295e-05 5.262e-05 8.471e-05 0.00% Amr::writeSmallPlotFile() 1 3.161e-05 6.982e-05 8.395e-05 0.00% FabArrayBase::getCPC() 20 4.093e-05 5.219e-05 7.09e-05 0.00% Castro::check_for_nan() 20 3.583e-05 4.823e-05 6.707e-05 0.00% Castro::advance() 10 4.08e-05 5.094e-05 6.492e-05 0.00% Amr::FinalizeInit() 1 4.478e-06 1.004e-05 5.127e-05 0.00% Castro::construct_new_hybrid_source() 10 1.708e-05 3.437e-05 4.446e-05 0.00% Gravity::swapTimeLevels() 10 1.747e-05 2.34e-05 3.376e-05 0.00% Castro::construct_old_hybrid_source() 10 1.585e-05 2.268e-05 3.355e-05 0.00% Castro::create_source_corrector() 10 1.63e-05 2.046e-05 2.929e-05 0.00% Castro::construct_new_rotation_source() 10 9.338e-06 1.452e-05 2.558e-05 0.00% AmrLevel::AmrLevel(dm) 1 8.512e-06 1.18e-05 1.738e-05 0.00% Amr::initSubcycle() 1 8.965e-06 1.433e-05 1.578e-05 0.00% Amr::InitializeInit() 1 3.014e-06 4.792e-06 1.416e-05 0.00% Castro::construct_old_rotation_source() 10 4.686e-06 8.017e-06 1.117e-05 0.00% Castro::FluxRegFineAdd() 10 7.569e-06 8.894e-06 1.049e-05 0.00% Castro::retry_advance_ctu() 10 5.259e-06 8.242e-06 9.71e-06 0.00% Castro::gwstrain() 11 6.575e-06 8.053e-06 9.589e-06 0.00% Castro::computeInitialDt() 2 3.456e-06 5.01e-06 9.467e-06 0.00% Gravity::set_mass_offset() 10 5.812e-06 7.138e-06 8.165e-06 0.00% AmrLevel::checkPointPost() 3 4.372e-06 6.401e-06 8.054e-06 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 5.397e-06 6.394e-06 7.225e-06 0.00% AmrLevel::checkPointPre() 3 3.366e-06 4.773e-06 6.456e-06 0.00% Castro::post_regrid() 1 3.058e-06 3.945e-06 4.772e-06 0.00% Amr::initialInit() 1 1.691e-06 2.723e-06 4.618e-06 0.00% Amr::init() 1 2.623e-06 3.36e-06 4.087e-06 0.00% DistributionMapping::Distribute() 1 1.662e-06 2.207e-06 2.768e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 3.068 3.068 3.069 100.00% Amr::coarseTimeStep() 10 2.649 2.649 2.649 86.33% Amr::timeStep() 10 2.609 2.609 2.609 85.01% Castro::advance() 10 2.533 2.554 2.561 83.46% Castro::subcycle_advance_ctu() 10 2.442 2.461 2.473 80.58% Castro::do_advance_ctu() 10 2.441 2.461 2.473 80.58% Castro::construct_ctu_hydro_source() 10 1.589 1.749 1.911 62.29% Amr::writePlotFile() 2 0.3595 0.3595 0.3595 11.72% FillPatchIterator::Initialize 251 0.1715 0.2089 0.2473 8.06% Amr::init() 1 0.2343 0.2345 0.2347 7.65% Castro::initialize_do_advance() 10 0.196 0.2093 0.2199 7.17% FillPatchSingleLevel 251 0.1326 0.1622 0.2056 6.70% FabArray::ParallelCopy() 251 0.09931 0.1319 0.1817 5.92% Castro::clean_state() 62 0.1321 0.1418 0.1565 5.10% Castro::expand_state() 10 0.13 0.1412 0.1489 4.85% FabArray::ParallelCopy_finish() 251 0.06646 0.09093 0.1416 4.62% Castro::do_old_sources() 10 0.04093 0.05965 0.1137 3.71% Castro::initialize_advance() 10 0.08048 0.09238 0.1033 3.37% Castro::computeTemp() 63 0.08622 0.09288 0.1023 3.33% FabArray::setVal() 164 0.07648 0.08899 0.09747 3.18% Castro::do_new_sources() 10 0.06846 0.0755 0.08822 2.87% Castro::post_timestep() 10 0.04756 0.05456 0.07595 2.48% Castro::reset_internal_energy() 63 0.0534 0.05743 0.06299 2.05% VisMF::Write(FabArray) 11 0.04163 0.04681 0.0598 1.95% FabArray::ParallelCopy_nowait() 251 0.03264 0.04076 0.0506 1.65% Amr::checkPoint() 3 0.04986 0.04999 0.05 1.63% Castro::estTimeStep() 21 0.01808 0.03046 0.04846 1.58% StateDataPhysBCFunct::() 251 0.01634 0.03018 0.04384 1.43% StateData::FillBoundary(geom) 20 0.01613 0.02994 0.04359 1.42% AmrLevel::checkPoint() 3 0.03089 0.03479 0.0415 1.35% StateData::checkPoint() 12 0.03083 0.03471 0.04136 1.35% Amr::initialInit() 1 0.0385 0.03858 0.03877 1.26% Castro::finalize_do_advance() 10 0.001952 0.02322 0.03015 0.98% Castro::normalize_species() 62 0.02536 0.02736 0.03006 0.98% Castro::construct_new_source() 70 0.02469 0.02661 0.02798 0.91% Amr::InitializeInit() 1 0.01665 0.02544 0.02701 0.88% Amr::defBaseLevel() 1 0.01664 0.02544 0.027 0.88% Castro::volWgtSum() 176 0.02163 0.02362 0.02601 0.85% Castro::construct_new_gravity_source() 10 0.02062 0.02213 0.02328 0.76% Amr::FinalizeInit() 1 0.01156 0.01314 0.02212 0.72% Castro::derive() 187 0.01696 0.01902 0.02116 0.69% Castro::hybrid_to_linear_momentum() 62 0.01676 0.01828 0.02095 0.68% Gravity::get_new_grav_vector() 11 0.01239 0.01508 0.01802 0.59% Castro::construct_new_gravity() 10 0.01143 0.01403 0.01789 0.58% Castro::check_for_nan() 20 0.00968 0.01221 0.01781 0.58% MultiFab::contains_nan() 20 0.009638 0.01216 0.01775 0.58% Castro::apply_source_to_state() 20 0.01143 0.01415 0.01639 0.53% MultiFab::Saxpy() 20 0.01138 0.01408 0.01631 0.53% FabArray::setDomainBndry() 251 0.005352 0.01002 0.01525 0.50% Castro::computeInitialDt() 2 0.002284 0.003859 0.01284 0.42% Castro::construct_old_gravity() 10 0.0088 0.01142 0.01276 0.42% Gravity::get_old_grav_vector() 10 0.008162 0.01065 0.01192 0.39% Castro::initData() 1 0.007354 0.01059 0.01138 0.37% Castro::construct_old_source() 70 0.008358 0.009514 0.01068 0.35% Gravity::add_pointmass_to_gravity() 21 0.007691 0.008549 0.009352 0.30% Castro::post_init() 1 0.00754 0.007705 0.008682 0.28% Castro::construct_old_gravity_source() 10 0.006353 0.007398 0.008487 0.28% Castro::computeNewDt() 9 0.007823 0.007924 0.007979 0.26% Castro::fill_hybrid_hydro_source() 30 0.005181 0.006297 0.007289 0.24% Castro::construct_new_hybrid_source() 10 0.003305 0.004337 0.005154 0.17% Castro::enforce_min_density() 62 0.004159 0.004645 0.005053 0.16% Castro::swap_state_time_levels() 10 0.003979 0.004327 0.004858 0.16% AmrLevel::AmrLevel(dm) 1 0.003225 0.004482 0.004707 0.15% StateData::define() 4 0.003216 0.00447 0.004695 0.15% Castro::post_regrid() 1 0.001704 0.002682 0.002846 0.09% Castro::construct_old_hybrid_source() 10 0.001735 0.002018 0.002284 0.07% Castro::locSquaredSum() 11 0.001124 0.001316 0.001622 0.05% Amr::InitAmr() 1 0.0002714 0.0004267 0.0005863 0.02% DistributionMapping::SFCProcessorMapDoIt() 1 1.863e-05 0.0001941 0.0003923 0.01% DistributionMapping::LeastUsedCPUs() 1 1.035e-05 0.0001855 0.000384 0.01% Castro::linear_to_hybrid_momentum() 1 0.000214 0.0002495 0.0003031 0.01% Castro::enforce_consistent_e() 1 5.987e-05 0.0001037 0.0001926 0.01% Castro::finalize_advance() 10 0.0001077 0.0001254 0.0001558 0.01% FabArrayBase::getCPC() 20 8.389e-05 0.0001006 0.00015 0.00% FabArrayBase::CPC::define() 2 2.955e-05 4.846e-05 8.749e-05 0.00% Castro::enforce_speed_limit() 62 4.295e-05 5.262e-05 8.471e-05 0.00% Amr::writeSmallPlotFile() 1 3.161e-05 6.982e-05 8.395e-05 0.00% Gravity::swapTimeLevels() 10 1.747e-05 2.34e-05 3.376e-05 0.00% Castro::create_source_corrector() 10 1.63e-05 2.046e-05 2.929e-05 0.00% Castro::construct_new_rotation_source() 10 9.338e-06 1.452e-05 2.558e-05 0.00% Amr::initSubcycle() 1 8.965e-06 1.433e-05 1.578e-05 0.00% Castro::construct_old_rotation_source() 10 4.686e-06 8.017e-06 1.117e-05 0.00% Castro::FluxRegFineAdd() 10 7.569e-06 8.894e-06 1.049e-05 0.00% Castro::retry_advance_ctu() 10 5.259e-06 8.242e-06 9.71e-06 0.00% Castro::gwstrain() 11 6.575e-06 8.053e-06 9.589e-06 0.00% Gravity::set_mass_offset() 10 5.812e-06 7.138e-06 8.165e-06 0.00% AmrLevel::checkPointPost() 3 4.372e-06 6.401e-06 8.054e-06 0.00% AmrLevel::checkPointPre() 3 3.366e-06 4.773e-06 6.456e-06 0.00% DistributionMapping::Distribute() 1 1.662e-06 2.207e-06 2.768e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-29-g329f81b889a6) finalized MPI initialized with 16 MPI processes MPI initialized with thread support level 3 AMReX (22.04-29-g329f81b889a6) initialized Starting run at 06:46:40 UTC on 2022-04-26. Successfully read inputs file ... Castro git describe: 22.04-28-g7e86dbe56 AMReX git describe: 22.04-29-g329f81b88 Microphysics git describe: 22.04-3-g3c498521 reading extern runtime parameters ... 3 Species: C12 O16 Mg24 restarting calculation from file: rotating_torus-restart_chk00005 Successfully read inputs file ... read CPU time: 28.77209614 Castro::numpts_1d at level 0 is 118 Moment of inertia = 2826.060054 Restart time = 0.036865058 seconds. ...estimated hydro-limited timestep at level 0: 0.002422517818 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002422517818 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002422517818 ... but limiting to: 0.0004263336576 = 1.05 * 0.0004060320549 [Level 0 step 6] ADVANCE with dt = 0.0004263336576  Beginning subcycle 1 starting at time 0.001845801625 with dt = 0.0004263336576 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007679086 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.282363888 Castro::do_new_sources() time = 0.009580317 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7000361196 [Level 0 step 6] Advanced 262144 cells Moment of inertia = 2826.017073 Moment of inertia / initial moment of inertia = 0.9999847911 TIME= 0.002272135282 MASS = 0.5935240411 TIME= 0.002272135282 XMOM = 4.440892099e-16 TIME= 0.002272135282 YMOM = 6.827871601e-15 TIME= 0.002272135282 ZMOM = -7.954161418e-12 TIME= 0.002272135282 ANG MOM X = -1.387778781e-17 TIME= 0.002272135282 ANG MOM Y = -1.179611964e-16 TIME= 0.002272135282 ANG MOM Z = 4.289006454 TIME= 0.002272135282 HYB MOM R = 0.008998825225 TIME= 0.002272135282 HYB MOM L = 4.289006454 TIME= 0.002272135282 HYB MOM P = -7.954161418e-12 TIME= 0.002272135282 RHO*e = 0.7135428282 TIME= 0.002272135282 RHO*K = 13.47734917 TIME= 0.002272135282 RHO*E = 14.190892 TIME= 0.002272135282 RHO*PHI = 0 TIME= 0.002272135282 TOTAL ENERGY= 14.190892 [STEP 6] Coarse TimeStep time: 0.384797171 [STEP 6] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 6 TIME = 0.002272135282 DT = 0.0004263336576 ...estimated hydro-limited timestep at level 0: 0.002054026253 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.002054026253 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.002054026253 ... but limiting to: 0.0004476503405 = 1.05 * 0.0004263336576 [Level 0 step 7] ADVANCE with dt = 0.0004476503405  Beginning subcycle 1 starting at time 0.002272135282 with dt = 0.0004476503405 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.007111869 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.270289505 Castro::do_new_sources() time = 0.008917508 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7431718015 [Level 0 step 7] Advanced 262144 cells Moment of inertia = 2825.989879 Moment of inertia / initial moment of inertia = 0.9999751688 TIME= 0.002719785623 MASS = 0.5935240411 TIME= 0.002719785623 XMOM = -1.887379142e-15 TIME= 0.002719785623 YMOM = 3.774758284e-15 TIME= 0.002719785623 ZMOM = -9.642922067e-12 TIME= 0.002719785623 ANG MOM X = -9.36750677e-17 TIME= 0.002719785623 ANG MOM Y = -2.775557562e-17 TIME= 0.002719785623 ANG MOM Z = 4.289006454 TIME= 0.002719785623 HYB MOM R = 0.01077138894 TIME= 0.002719785623 HYB MOM L = 4.289006454 TIME= 0.002719785623 HYB MOM P = -9.642922067e-12 TIME= 0.002719785623 RHO*e = 0.7138174014 TIME= 0.002719785623 RHO*K = 13.47770671 TIME= 0.002719785623 RHO*E = 14.19152411 TIME= 0.002719785623 RHO*PHI = 0 TIME= 0.002719785623 TOTAL ENERGY= 14.19152411 [STEP 7] Coarse TimeStep time: 0.365689387 [STEP 7] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 7 TIME = 0.002719785623 DT = 0.0004476503405 ...estimated hydro-limited timestep at level 0: 0.001791126456 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001791126456 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001791126456 ... but limiting to: 0.0004700328575 = 1.05 * 0.0004476503405 [Level 0 step 8] ADVANCE with dt = 0.0004700328575  Beginning subcycle 1 starting at time 0.002719785623 with dt = 0.0004700328575 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.00676775 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.263038933 Castro::do_new_sources() time = 0.008740743 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.7595501727 [Level 0 step 8] Advanced 262144 cells Moment of inertia = 2825.975647 Moment of inertia / initial moment of inertia = 0.9999701325 TIME= 0.00318981848 MASS = 0.5935240411 TIME= 0.00318981848 XMOM = 9.992007222e-16 TIME= 0.00318981848 YMOM = 1.665334537e-16 TIME= 0.00318981848 ZMOM = -1.141697121e-11 TIME= 0.00318981848 ANG MOM X = 6.938893904e-18 TIME= 0.00318981848 ANG MOM Y = -6.245004514e-17 TIME= 0.00318981848 ANG MOM Z = 4.289006454 TIME= 0.00318981848 HYB MOM R = 0.01263236378 TIME= 0.00318981848 HYB MOM L = 4.289006454 TIME= 0.00318981848 HYB MOM P = -1.141697121e-11 TIME= 0.00318981848 RHO*e = 0.7140922963 TIME= 0.00318981848 RHO*K = 13.47805002 TIME= 0.00318981848 RHO*E = 14.19214232 TIME= 0.00318981848 RHO*PHI = 0 TIME= 0.00318981848 TOTAL ENERGY= 14.19214232 [STEP 8] Coarse TimeStep time: 0.35702323 [STEP 8] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 8 TIME = 0.00318981848 DT = 0.0004700328575 ...estimated hydro-limited timestep at level 0: 0.001590548666 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001590548666 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001590548666 ... but limiting to: 0.0004935345004 = 1.05 * 0.0004700328575 [Level 0 step 9] ADVANCE with dt = 0.0004935345004  Beginning subcycle 1 starting at time 0.00318981848 with dt = 0.0004935345004 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.006296441 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.213828816 Castro::do_new_sources() time = 0.009293019 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 0.9096366563 [Level 0 step 9] Advanced 262144 cells Moment of inertia = 2825.983195 Moment of inertia / initial moment of inertia = 0.9999728034 TIME= 0.003683352981 MASS = 0.5935240411 TIME= 0.003683352981 XMOM = -5.551115123e-16 TIME= 0.003683352981 YMOM = -2.498001805e-15 TIME= 0.003683352981 ZMOM = -1.32791597e-11 TIME= 0.003683352981 ANG MOM X = 9.020562075e-17 TIME= 0.003683352981 ANG MOM Y = 1.387778781e-17 TIME= 0.003683352981 ANG MOM Z = 4.289006454 TIME= 0.003683352981 HYB MOM R = 0.01458610189 TIME= 0.003683352981 HYB MOM L = 4.289006454 TIME= 0.003683352981 HYB MOM P = -1.32791597e-11 TIME= 0.003683352981 RHO*e = 0.7143408385 TIME= 0.003683352981 RHO*K = 13.47834086 TIME= 0.003683352981 RHO*E = 14.19268169 TIME= 0.003683352981 RHO*PHI = 0 TIME= 0.003683352981 TOTAL ENERGY= 14.19268169 [STEP 9] Coarse TimeStep time: 0.296668364 [STEP 9] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 9 TIME = 0.003683352981 DT = 0.0004935345004 ...estimated hydro-limited timestep at level 0: 0.001432337647 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001432337647 Castro::compute_new_dt : limiting dt at level 0 ... new dt computed: 0.001432337647 ... but limiting to: 0.0005182112254 = 1.05 * 0.0004935345004 [Level 0 step 10] ADVANCE with dt = 0.0005182112254  Beginning subcycle 1 starting at time 0.003683352981 with dt = 0.0005182112254 Estimated number of subcycles remaining: 1 Castro::do_old_sources() time = 0.005860767 ... Entering construct_ctu_hydro_source() ... Leaving construct_ctu_hydro_source() Castro::construct_ctu_hydro_source() time = 0.178077602 Castro::do_new_sources() time = 0.009525708 ...estimated hydro-limited timestep at level 0: 0.001305227986 Castro::estTimeStep (hydro-limited) at level 0: estdt = 0.001305227986  Subcycle completed Subcycling complete Zones advanced per microsecond at this level: 1.066747558 [Level 0 step 10] Advanced 262144 cells Moment of inertia = 2826.014035 Moment of inertia / initial moment of inertia = 0.9999837161 TIME= 0.004201564206 MASS = 0.5935240411 TIME= 0.004201564206 XMOM = -4.329869796e-15 TIME= 0.004201564206 YMOM = -5.939693182e-15 TIME= 0.004201564206 ZMOM = -1.523249403e-11 TIME= 0.004201564206 ANG MOM X = -1.630640067e-16 TIME= 0.004201564206 ANG MOM Y = 4.163336342e-17 TIME= 0.004201564206 ANG MOM Z = 4.289006454 TIME= 0.004201564206 HYB MOM R = 0.01663716124 TIME= 0.004201564206 HYB MOM L = 4.289006454 TIME= 0.004201564206 HYB MOM P = -1.523249403e-11 TIME= 0.004201564206 RHO*e = 0.7145679066 TIME= 0.004201564206 RHO*K = 13.47857813 TIME= 0.004201564206 RHO*E = 14.19314603 TIME= 0.004201564206 RHO*PHI = 0 TIME= 0.004201564206 TOTAL ENERGY= 14.19314603 [STEP 10] Coarse TimeStep time: 0.253540401 [STEP 10] FAB kilobyte spread across MPI nodes: [50507 ... 50507] STEP = 10 TIME = 0.004201564206 DT = 0.0005182112254 PLOTFILE: file = rotating_torus-restart_plt00010 Write plotfile time = 0.108704562 seconds Ending run at 06:46:42 UTC on 2022-04-26. Run time = 1.807440975 Run time without initialization = 1.770159507 Average number of zones advanced per microsecond: 0.740 Average number of zones advanced per microsecond per rank: 0.046 TinyProfiler total time across processes [min...avg...max]: 1.806 ... 1.807 ... 1.807 ------------------------------------------------------------------------------------------- Name NCalls Excl. Min Excl. Avg Excl. Max Max % ------------------------------------------------------------------------------------------- Castro::construct_ctu_hydro_source() 5 0.7517 1.0401 1.2242 67.73% Castro::do_advance_ctu() 5 0.01224 0.1918 0.4827 26.71% FabArray::ParallelCopy_finish() 116 0.02799 0.05768 0.1074 5.94% Amr::writePlotFile() 1 0.1006 0.1028 0.1041 5.76% Castro::do_old_sources() 5 8.899e-05 0.01018 0.06588 3.65% FabArray::setVal() 80 0.03551 0.04641 0.05296 2.93% Castro::reset_internal_energy() 30 0.02525 0.03107 0.03984 2.20% StateData::FillBoundary(geom) 10 0.01007 0.02185 0.03666 2.03% Castro::estTimeStep() 10 0.009732 0.01889 0.03515 1.94% FabArray::ParallelCopy_nowait() 116 0.01524 0.02348 0.03203 1.77% FillPatchIterator::Initialize 116 0.01721 0.02282 0.02677 1.48% Castro::post_timestep() 5 0.002161 0.01297 0.02612 1.44% Castro::do_new_sources() 5 8.48e-05 0.003303 0.02401 1.33% Castro::computeTemp() 30 0.01537 0.01915 0.02393 1.32% Castro::finalize_do_advance() 5 0.008499 0.01633 0.02153 1.19% VisMF::Read() 3 0.01564 0.01825 0.02022 1.12% Castro::expand_state() 5 0.008103 0.01418 0.01967 1.09% Castro::normalize_species() 30 0.01215 0.01509 0.01855 1.03% Castro::initialize_do_advance() 5 0.01098 0.01435 0.01709 0.95% Castro::construct_new_gravity_source() 5 0.01213 0.01419 0.01557 0.86% Castro::hybrid_to_linear_momentum() 30 0.008223 0.01108 0.01467 0.81% Castro::initialize_advance() 5 0.00762 0.01145 0.01451 0.80% Amr::restart() 1 0.008137 0.01248 0.01305 0.72% MultiFab::contains_nan() 10 0.006306 0.008364 0.01146 0.63% MultiFab::Saxpy() 10 0.006147 0.008101 0.009821 0.54% VisMF::Write(FabArray) 1 0.005663 0.006951 0.009177 0.51% Castro::derive() 86 0.004879 0.006219 0.008013 0.44% Gravity::get_new_grav_vector() 5 0.003492 0.005244 0.007393 0.41% Castro::construct_old_gravity_source() 5 0.002817 0.004601 0.007073 0.39% FabArray::setDomainBndry() 116 0.002672 0.00516 0.006823 0.38% Gravity::add_pointmass_to_gravity() 10 0.003779 0.004738 0.0058 0.32% Castro::post_restart() 1 5.478e-05 0.001285 0.005704 0.32% Castro::swap_state_time_levels() 5 0.004103 0.004482 0.004667 0.26% Castro::fill_hybrid_hydro_source() 15 0.00257 0.003799 0.004641 0.26% StateData::restartDoit() 4 0.002741 0.003658 0.003978 0.22% DistributionMapping::LeastUsedCPUs() 1 9.046e-06 0.0002652 0.003587 0.20% Gravity::get_old_grav_vector() 5 0.002116 0.003027 0.003343 0.18% Castro::enforce_min_density() 30 0.002087 0.002624 0.003236 0.18% Castro::volWgtSum() 80 0.002469 0.002707 0.003092 0.17% main() 1 0.001659 0.002368 0.002672 0.15% Castro::finalize_advance() 5 0.0002697 0.001348 0.001757 0.10% Castro::subcycle_advance_ctu() 5 3.058e-05 6.879e-05 0.0004565 0.03% Amr::InitAmr() 1 0.0002469 0.0003772 0.0004277 0.02% Castro::locSquaredSum() 6 0.0002155 0.0002914 0.0003595 0.02% Amr::coarseTimeStep() 5 0.0001964 0.0002572 0.0003577 0.02% AmrLevel::restart() 1 0.0001276 0.0002085 0.0002415 0.01% Castro::clean_state() 30 0.0001147 0.0001586 0.0001981 0.01% StateDataPhysBCFunct::() 116 8.71e-05 0.0001238 0.0001864 0.01% FillPatchSingleLevel 116 7.914e-05 0.0001026 0.0001442 0.01% FabArray::ParallelCopy() 116 6.629e-05 9.085e-05 0.0001149 0.01% FabArrayBase::CPC::define() 2 3.525e-05 6.362e-05 0.0001082 0.01% Castro::construct_new_source() 35 4.49e-05 7.401e-05 0.0001057 0.01% Castro::computeNewDt() 5 5.055e-06 1.178e-05 9.48e-05 0.01% Castro::construct_new_gravity() 5 2.727e-05 4.799e-05 8.784e-05 0.00% Castro::construct_old_source() 35 3.214e-05 4.914e-05 7.904e-05 0.00% Castro::construct_old_gravity() 5 3.285e-05 4.531e-05 6.804e-05 0.00% Amr::timeStep() 5 2.697e-05 3.478e-05 5.869e-05 0.00% Castro::check_for_nan() 10 1.804e-05 2.99e-05 5.503e-05 0.00% Castro::enforce_speed_limit() 30 2.551e-05 3.336e-05 4.007e-05 0.00% Amr::writeSmallPlotFile() 1 2.819e-05 3.538e-05 3.964e-05 0.00% Castro::construct_new_hybrid_source() 5 1.228e-05 2.489e-05 3.951e-05 0.00% Castro::apply_source_to_state() 10 1.762e-05 2.833e-05 3.811e-05 0.00% FabArrayBase::getCPC() 10 2.07e-05 2.723e-05 3.616e-05 0.00% Castro::advance() 5 2.306e-05 2.751e-05 3.122e-05 0.00% Castro::create_source_corrector() 5 7.176e-06 1.473e-05 2.338e-05 0.00% Gravity::swapTimeLevels() 5 9.344e-06 1.433e-05 2.23e-05 0.00% Castro::construct_new_rotation_source() 5 5.384e-06 7.676e-06 1.644e-05 0.00% Castro::construct_old_hybrid_source() 5 7.891e-06 1.148e-05 1.579e-05 0.00% Amr::initSubcycle() 1 8.163e-06 1.354e-05 1.575e-05 0.00% DistributionMapping::SFCProcessorMapDoIt() 1 4.738e-06 7.447e-06 1.502e-05 0.00% Castro::construct_old_rotation_source() 5 2.877e-06 4.74e-06 7.772e-06 0.00% Castro::gwstrain() 5 4.02e-06 5.531e-06 7.39e-06 0.00% Castro::retry_advance_ctu() 5 3.707e-06 5.257e-06 6.828e-06 0.00% Gravity::set_mass_offset() 6 4.094e-06 5.231e-06 6.643e-06 0.00% Castro::FluxRegFineAdd() 5 3.264e-06 4.477e-06 6.164e-06 0.00% Amr::init() 1 1.004e-06 1.684e-06 5.779e-06 0.00% DistributionMapping::Distribute() 1 1.454e-06 2.31e-06 4.232e-06 0.00% AmrLevel::AmrLevel() 1 9.09e-07 1.683e-06 3.981e-06 0.00% ------------------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------- Name NCalls Incl. Min Incl. Avg Incl. Max Max % ------------------------------------------------------------------------------------------- main() 1 1.806 1.807 1.807 100.00% Amr::coarseTimeStep() 5 1.658 1.658 1.658 91.72% Amr::timeStep() 5 1.652 1.652 1.652 91.41% Castro::advance() 5 1.606 1.615 1.62 89.63% Castro::subcycle_advance_ctu() 5 1.55 1.556 1.567 86.67% Castro::do_advance_ctu() 5 1.55 1.556 1.566 86.67% Castro::construct_ctu_hydro_source() 5 0.7517 1.04 1.224 67.73% FillPatchIterator::Initialize 116 0.1048 0.1314 0.1602 8.86% Castro::initialize_do_advance() 5 0.1169 0.1301 0.1516 8.39% FillPatchSingleLevel 116 0.08418 0.1034 0.1398 7.73% FabArray::ParallelCopy() 116 0.04758 0.08134 0.1289 7.13% Amr::writePlotFile() 1 0.1098 0.1098 0.1098 6.07% FabArray::ParallelCopy_finish() 116 0.02799 0.05768 0.1074 5.94% Castro::expand_state() 5 0.08415 0.09007 0.102 5.65% Castro::clean_state() 30 0.06325 0.0792 0.09974 5.52% Castro::do_old_sources() 5 0.01908 0.03556 0.08805 4.87% Castro::initialize_advance() 5 0.04089 0.05711 0.06666 3.69% Castro::computeTemp() 30 0.04062 0.05022 0.06311 3.49% Castro::do_new_sources() 5 0.03422 0.04487 0.05919 3.27% FabArray::setVal() 80 0.03551 0.04641 0.05296 2.93% Castro::post_timestep() 5 0.03208 0.03761 0.04589 2.54% Castro::reset_internal_energy() 30 0.02525 0.03107 0.03984 2.20% Amr::init() 1 0.03666 0.03672 0.03689 2.04% Amr::restart() 1 0.03666 0.03672 0.03689 2.04% StateDataPhysBCFunct::() 116 0.01017 0.02198 0.0368 2.04% StateData::FillBoundary(geom) 10 0.01007 0.02185 0.03666 2.03% Castro::estTimeStep() 10 0.009732 0.01889 0.03515 1.94% FabArray::ParallelCopy_nowait() 116 0.0153 0.02357 0.03213 1.78% AmrLevel::restart() 1 0.01874 0.02249 0.02677 1.48% StateData::restartDoit() 4 0.01856 0.02201 0.02302 1.27% Castro::finalize_do_advance() 5 0.008499 0.01633 0.02153 1.19% VisMF::Read() 3 0.01564 0.01825 0.02022 1.12% Castro::construct_new_source() 35 0.01382 0.01693 0.01885 1.04% Castro::normalize_species() 30 0.01215 0.01509 0.01855 1.03% Castro::volWgtSum() 80 0.01113 0.01483 0.01812 1.00% Castro::derive() 86 0.009233 0.01269 0.01563 0.86% Castro::construct_new_gravity_source() 5 0.01213 0.01419 0.01557 0.86% Castro::hybrid_to_linear_momentum() 30 0.008223 0.01108 0.01467 0.81% Castro::construct_new_gravity() 5 0.006249 0.008984 0.01263 0.70% Gravity::get_new_grav_vector() 5 0.00587 0.008476 0.01186 0.66% Castro::check_for_nan() 10 0.006325 0.008394 0.01151 0.64% MultiFab::contains_nan() 10 0.006306 0.008364 0.01146 0.63% Castro::apply_source_to_state() 10 0.006169 0.00813 0.009856 0.55% MultiFab::Saxpy() 10 0.006147 0.008101 0.009821 0.54% VisMF::Write(FabArray) 1 0.005663 0.006951 0.009177 0.51% Castro::construct_old_source() 35 0.003783 0.005835 0.008692 0.48% Castro::construct_old_gravity() 5 0.005434 0.006415 0.00729 0.40% Castro::construct_old_gravity_source() 5 0.002817 0.004601 0.007073 0.39% Gravity::get_old_grav_vector() 5 0.005008 0.005996 0.006843 0.38% FabArray::setDomainBndry() 116 0.002672 0.00516 0.006823 0.38% Castro::post_restart() 1 0.0003719 0.001583 0.005964 0.33% Gravity::add_pointmass_to_gravity() 10 0.003779 0.004738 0.0058 0.32% Castro::computeNewDt() 5 0.005293 0.0054 0.005459 0.30% Castro::swap_state_time_levels() 5 0.004103 0.004482 0.004667 0.26% Castro::fill_hybrid_hydro_source() 15 0.00257 0.003799 0.004641 0.26% DistributionMapping::SFCProcessorMapDoIt() 1 1.896e-05 0.000275 0.003607 0.20% DistributionMapping::LeastUsedCPUs() 1 9.046e-06 0.0002652 0.003587 0.20% Castro::enforce_min_density() 30 0.002087 0.002624 0.003236 0.18% Castro::construct_new_hybrid_source() 5 0.00164 0.002655 0.003224 0.18% Castro::finalize_advance() 5 0.000273 0.001352 0.001762 0.10% Castro::construct_old_hybrid_source() 5 0.0009085 0.00118 0.001534 0.08% Castro::locSquaredSum() 6 0.000724 0.0008517 0.0009516 0.05% Amr::InitAmr() 1 0.0002561 0.0003907 0.0004422 0.02% FabArrayBase::getCPC() 10 6.093e-05 9.086e-05 0.0001444 0.01% FabArrayBase::CPC::define() 2 3.525e-05 6.362e-05 0.0001082 0.01% Castro::enforce_speed_limit() 30 2.551e-05 3.336e-05 4.007e-05 0.00% Amr::writeSmallPlotFile() 1 2.819e-05 3.538e-05 3.964e-05 0.00% Castro::create_source_corrector() 5 7.176e-06 1.473e-05 2.338e-05 0.00% Gravity::swapTimeLevels() 5 9.344e-06 1.433e-05 2.23e-05 0.00% Castro::construct_new_rotation_source() 5 5.384e-06 7.676e-06 1.644e-05 0.00% Amr::initSubcycle() 1 8.163e-06 1.354e-05 1.575e-05 0.00% Castro::construct_old_rotation_source() 5 2.877e-06 4.74e-06 7.772e-06 0.00% Castro::gwstrain() 5 4.02e-06 5.531e-06 7.39e-06 0.00% Castro::retry_advance_ctu() 5 3.707e-06 5.257e-06 6.828e-06 0.00% Gravity::set_mass_offset() 6 4.094e-06 5.231e-06 6.643e-06 0.00% Castro::FluxRegFineAdd() 5 3.264e-06 4.477e-06 6.164e-06 0.00% DistributionMapping::Distribute() 1 1.454e-06 2.31e-06 4.232e-06 0.00% AmrLevel::AmrLevel() 1 9.09e-07 1.683e-06 3.981e-06 0.00% ------------------------------------------------------------------------------------------- Unused ParmParse Variables: [TOP]::castro.center(nvals = 3) :: [0.0, 0.0, 0.0] [TOP]::amr.ref_ratio(nvals = 4) :: [2, 2, 2, 2] [TOP]::amr.regrid_int(nvals = 1) :: [-1] [TOP]::problme.outer_radius(nvals = 1) :: [1.50] AMReX (22.04-29-g329f81b889a6) finalized