Adding SemUCB model to SpecFEM3D_globe

[dosoe]

Hi all,
I'm Dorian Soergel, I'm a postdoc with Barbara Romanowicz (@barbara-brz) at UC Berkeley. I have been trying to integrate SemUCB with its attached parametrisation and crust into SpecFEM3D_globe. For this there are four parts:

• the source, as we use a smoothed heaviside as a source function
• the 1D model, which contains the average 1D model
• the crust, which is constituted of a single layer and is computed from inverting surface waves
• the 3D perturbations of the 1D model

I have been working on this on this branch: https://github.com/dosoe/specfem3d_globe/tree/devel and have successfully implemented the source and the 1D model. I'm now working on the crust and the 3D perturbations.
As a first step, I would like to separate the crust and the 3D perturbations to be able to integrate them separately. Currently, I use the following in src/shared/get_model_parameters.f90 to integrate 1D model, 3D perturbations and custom crust:

case('semucb_a3d')
    CASE_3D = .true.
    CRUSTAL = .true.
    ONE_CRUST = .true.
    REFERENCE_1D_MODEL = REFERENCE_MODEL_SEMUCB
    TRANSVERSE_ISOTROPY = .true.
    MODEL_3D_MANTLE_PERTUBATIONS = .true.
    THREE_D_MODEL = THREE_D_MODEL_BERKELEY
    ATTENUATION_3D = .false.

For a test case that only uses the 1D model (no custom crust or 3D perturbations), I use the following settings in the same file:

case('prem_a3d_test') 
    CASE_3D = .false.
    CRUSTAL = .false.
    ONE_CRUST = .false.
    REFERENCE_1D_MODEL = REFERENCE_MODEL_SEMUCB
    TRANSVERSE_ISOTROPY = .true.
    MODEL_3D_MANTLE_PERTUBATIONS = .true.
    THREE_D_MODEL = THREE_D_MODEL_BERKELEY

If I want only to enable the crust, is it as simple as putting CRUSTAL = .true. and ONE_CRUST = .true.?
As for the 3D part, I'm a little confused as for what CASE_3D and MODEL_3D_MANTLE_PERTUBATIONS mean, are they redundant? or is it that the former means 'there is a 3D model' when the latter just means 'behave as if you had a 3D model, regardless whether it is true or not' ?

Regards,
Dorian

[dosoe]

I have tried to isolate the effect of the crust by setting ONE_CRUST=.true. and CRUSTAL=.true. , but keeping CASE_3D=.false. . This still leads to significant differences between specfem 7.0 and 8.1 . I have noticed a slight difference in get_model where the conversions between spherical and cartesian coordinates happen at different timings, but I walked through it, it should not change anything. Is there any significant difference in the way the crust is processed between 7.0 and 8.1? I can't find it.

[danielpeter]

agree, these flags are quite confusing and the naming is not very intuitive - and their functionality depends on a number of other settings...

in general, the idea of the mesher is to take a 1D reference model (defined for inner core, outer core, mantle & crust, like PREM) and overimpose 3D mantle variations (usually given as perturbations wrt the 1D model value), and if possible 3D crustal variations.

so, MODEL_3D_MANTLE_PERTUBATIONS is used to indicate that there is an additional mantle model with 3D variations. if this is .false., it will only take the 1D reference model values for the mantle.

CRUSTAL is used to indicate that there is an additional crustal model with 3D variations. if this is .false., it will only take the 1D reference model values for the crust.

the other flags are shortly explained in the code file get_model_parameters.f90:

  ! ONE_CRUST: in order to increase stability and therefore to allow cheaper
  ! simulations (larger time step), 1D models can be run with just one average crustal
  ! layer instead of two.
  !
  ! CASE_3D : this flag allows the stretching of the elements in the crustal
  ! layers in the case of 3D models. The purpose of this stretching is to squeeze more
  ! GLL points per km in the upper part of the crust than in the lower part.
  !
  ! CRUSTAL : flag set to .true. if a 3D crustal model (e.g. Crust-2.0) will be used or
  !  to .false. for a 1D crustal model.

the use of these flags for crustal models depends if you're using a 1D crust from a 1D reference model, or if you're overimposing a 3D crustal model on top:

• 1D crustal models: ONE_CRUST simplifies the crust layer to use only 1 crustal element layer, instead of default 2 layers for the crust. this can help to increase the stability and time step size for simplified modeling. PREM for example has 2 crustal layers, an upper and lower crust. if this ONE_CRUST flag is set, it ignores the lower crust and uses the upper crust values for the whole crust.

• 3D crustal models: the CRUSTAL is used to specify that you're overimposing a 3D crustal model on top of a mantle model, instead of using the 1D crustal model of the reference model. CASE_3D is stretching upper/lower crustal elements to have a thinner upper layer to 3D crustal models. and ONE_CRUST in this case is mostly used to simplify the setup of the crustal layering. 3D crustal models will always use at least 2 element layers for the crust. i think there is not much difference if you would leave this flag to .false. as the 3D crustal model is overimposed at a later stage anyway. however, most 3D models use this flag for their setup.

therefore, for a 3D crustal model, you should set CRUSTAL and CASE_3D to .true. to have the crustal stretching and honoring of the 3D moho depth variations.

[dosoe]

Hi Daniel,
I have done a run with specfem with a model that takes the full 3D parametrisation (1D model, crustal model, 3D perturbations, i. e. MODEL='semucb_a3d_brk') but where the 3D perturbations have all been set to zero. The result is shown here, as a section. In black, the results obtained with the older version of specfem, in red the results of the current implementation of SemUCB in version 8.1 . I believe the discrepancies are due to problems in reading the crustal model, as the 3D part has been set to zero.
I have gone through the source code, it seems like there is a difference in when the conversions between cartesian, spherical and lat/lon take place between specfem 7.0 and 8.1, but following through the calculations, it does not look like it should make a difference. Do I understand correctly that in meshfem3D_model_crust when it calls the different crusts it is expecting values of vpv,vsv,vph,vsh for the given latitude, longitude and depth?

[danielpeter]

that's correct, the meshfem3D_model_crust() routines returns the crustal properties for a given lat/lon/r position.

and yes, there are differences related to how the geodetic (lat/lon) coordinates are converted to geocentric (theta/phi) coordinates and vice versa between version 7.0 and 8.1. also, the source positioning has slightly changed.

[dosoe]

Hi Daniel,
Yes, I have seen that there are slight differences because the code now takes into account ellipticity and converts from geocentric to geographic coordinates. Is that what you are talking about, or is it something else?

[dosoe]

Just to be sure, if ELLIPTICITY is .false., there is no difference with the older code, right?

[dosoe]

Hi Daniel,
I have tried to track down the issue with the crust. I have gone as far as printing the crustal values by inserting this print statement in specfem 8.1 and 7.0 in the get_model subroutine (visible in the last commit on my devel branch):

call xyz_2_rthetaphi_dble(0.d0,0.d0,1.d0,r_test,theta_test,phi_test)
call meshfem3D_models_get3Dcrust_val(IREGION_CRUST_MANTLE,r_test,theta_test,phi_test, &
                                                  vpv,vph,vsv,vsh,rho,eta_aniso, &
                                                  c11,c12,c13,c14,c15,c16,c22,c23,c24,c25,c26, &
                                                  c33,c34,c35,c36,c44,c45,c46,c55,c56,c66, &
                                                  elem_in_crust,moho,sediment)
print *,'x=0,y=0,z=1,vpv=',vpv

call xyz_2_rthetaphi_dble(1.d0,0.d0,0.d0,r_test,theta_test,phi_test)
call meshfem3D_models_get3Dcrust_val(IREGION_CRUST_MANTLE,r_test,theta_test,phi_test, &
                                                  vpv,vph,vsv,vsh,rho,eta_aniso, &
                                                  c11,c12,c13,c14,c15,c16,c22,c23,c24,c25,c26, &
                                                  c33,c34,c35,c36,c44,c45,c46,c55,c56,c66, &
                                                  elem_in_crust,moho,sediment)
print *,'x=1,y=0,z=0,vpv=',vpv

and equivalent ones in specfem 7.0 ( it is not quite the same, because at this stage specfem 7.0 still works in cartesian coordinates while specfem 8.1 has already switched to spherical coordinates). When ELLIPTICITY is turned off and the inputs are double precision, the results are identical (when they are not in double precision the results are not, but as far as I can find out in the code, the inputs should always be double precision). I haven't tried with ELLIPTICITY turned on, but I anticipate that there will be some difference, because of the way the conversions are done in 8.1 with thetaphi_2_geographic_latlon_dble. At this point, I would like it to agree at least with all flags from the Par_file turned off.
After that, get_model is functionally identical (there are a few shenanigans with CUSTOM_REAL that shouldn't apply to our case, as it is set to SIZE_REAL). This is the only place where the crustal models are actually queried, and I would expect that any difference at a later stage would also show up for 1D models, which run identically now between specfem 8.1 and 7.0.

Is there any other place where the crustal model or the 3D model could make a difference?

[dosoe]

Hi @danielpeter ,
I have added further print statements in get_model . I now print the values of all elastic parameters (r rho kappav kappah muv muh eta_aniso) for a 3D model with a 3D crust . I have set all 3D perturbations to zero and put in a homogeneous crustal model, but it is read and handled as a 3D model. This means that the elastic parameters depend only on the radius.
Looking at the printed out values, the values of all these elastic parameters are identical in specfem 7.0 and 8.1 for equal radius:
7.0:

 r  0.751737915195389      rho  0.8888547     kappav   1.718933     kappah  1.724061     muv  0.8554026     muh  0.8567953     eta_aniso  0.9959435

8.1:

r  0.751737915195389      rho  0.8888547     kappav   1.718933     kappah   1.724061     muv  0.8554026     muh  0.8567953     eta_aniso  0.9959435

It seems thus that reading the model is not a problem, and yet the seismograms are substantially different (see earlier plot, I have only added and removed print statements so it shouldn't have changed).
I have run the same tests on a 1D model, and the results are identical, which leaves me to believe that the source-time function or the source and receiver locations are not the problem. Is there a later point in the code where the different models make a difference other than in get_model? I am very puzzled by this behaviour. To be safe, I have disabled all optional flags from the Par_file (so no ellipticity or topography), the simulation is global so no ABSORBING_BOUNDARY_CONDITIONS and ANISOTROPIC_INNER_CORE and the model is not fully anisotropic, so ATTENUATION_3D_MANTLE is false in both 7.0 and 8.1 .
Dorian

[dosoe]

Hi @danielpeter ,
I haven't found the problem with the integration of semucb into specfem.
One thing I would like to try is to print out the mesh in a text file to compare the meshes. For this, I would like to know: Has the way the mesh is distributed over the cores the same in 8.1 and in 7.0? If so, I can compare the output of the individual cores, i. e. I can expect that the elements created by core 1 are the same in 7.0 and 8.1 and any difference would be due to differences in the model.
Regards,
Dorian

[danielpeter]

hi Dorian, sorry for this delay. there are many changes between version 7.0 and 8.1, so i think the mesh layout will have changed slightly from version 7.0 to 8.1 as well. comparing these version's mesh point-by-point, i would expect that they are at slightly different positions.

[dosoe]

Hi Daniel, thanks for the answer. I have tracked down the source of the problem being the crust. However, while benchmarking, I noticed that the devel branch does not match the master branch, I submitted an issue about it here: SPECFEM/specfem3d_globe#846
This means I cannot compare the results of my runs in the devel branch and my fork of specfem3d_globe, so for now I will work on the master branch and merge it with the devel branch later.

[dosoe]

Hi Daniel,
I have updated my fork to match exactly what I'm running (including stations and source) and checked it compiles.
It has a lot of output, but it runs.
You can find it here: https://github.com/dosoe/specfem3d_globe/tree/devel
I will try out paraview today.
Regards,
Dorian

[danielpeter]

great, got it. do you have the previous implementation for version 7 inside this repo as well or at a different location?

[dosoe]

No, I don't have it inside the repo, actually I only have it in the repo for my group which is private. I will create a repo for it, I'll point you to it as soon as it is online.

[dosoe]

I just uploaded it to this repo (in the main branch): https://github.com/dosoe/Specfem3d_globe_7.0_Berkeley/tree/main

[barbara-brz]

Hi Daniel and Dorian, Perhaps this could help direct the investigations. I had first checked Dorian's version 7 against the one we have been running for years at NERSC, and they match for 3D model SEMUCB with all flags turned on in Pari_file (attenuation, ellipticity etc..). I enclose 4 plots for a specific example source-station with a low pass corner and cut-off at 53 and 40 s, respectively, so rather long period. Model is SEMUCB with its 3D crust. The source is a deep earthquake (> 600 km) to contrast with the test that Dorian has been doing with a shallow event. In all cases, the attenuation model is our 1D model (QL6). version 7 = "old" version 8 = "new" 1) compares version 7 against version 8 (the one Dorian is working on) with all flags turned on in Par_file (attenuation, ellipticity etc..). The amplitudes in version 8 are much too large, especially for body waves that include a reflection (much smaller differences for the direct P and S waves). This might indicate some issue with the 3D crust implementation??. I ruled out the effect of the flag ATTENUATION_1D_WITH_3D_STORAGE, as it does not change anything whether it is turned on or off. 2) compares version 8 with and without attenuation (all other flags turned on). They practically match in amplitude, there is "only" a variable phase shift. 3) comparing version 7 with and without attenuation. 4) For reference I also include the comparison of 8 and 7 runs without attenuation, which unfortunately do not match. Note that surface wave Airy phases match more or less in amplitude, better than the reflected SS, SP,SSS... It looks like it might be an issue with the crust implementation, but haven't found yet where that could happen. I hope this example might be useful - happy to clarify as needed - sorry the plots are not all exactly at the same y scale, but I didn't want to put too many traces on the same plot. regards Barbara

…

On Wed, Oct 2, 2024 at 12:27 PM Dorian Soergel ***@***.***> wrote: I just uploaded it to this repo (in the main branch): https://github.com/dosoe/Specfem3d_globe_7.0_Berkeley/tree/main — Reply to this email directly, view it on GitHub <#1718 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BJEVZDOUXVUUHEZLX2R53GTZZRCIXAVCNFSM6AAAAABKSRHCXGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBSGQ3DEMQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[dosoe]

Hi Barbara, it seems like the plots didn't come through.

[dosoe]

Here are the figures mentioned by Barbara:
TAM_time_C20240128-old-QnoQ.pdf
TAM_time_C20240128-noQ.pdf
TAM_time_C20240128-new-QnoQ.pdf
TAM_time_C20240128-new-old.pdf

[dosoe]

So the attenuation works in the 1D case, but not in the 3d case, right? Do we have 3d attenuation, i e is there a scaling between attenuation and 3d perturbations? I don't believe so, but you will know better than me.

[barbara-brz]

no 3D attenuation in the model

…

On Thu, Oct 3, 2024 at 4:30 PM Dorian Soergel ***@***.***> wrote: So the attenuation works in the 1D case, but not in the 3d case, right? Do we have 3d attenuation, i e is there a scaling between attenuation and 3d perturbations? I don't believe so, but you will know better than me. — Reply to this email directly, view it on GitHub <#1718 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BJEVZDOLKTRKL3FI7QJ3SGLZZXHRZAVCNFSM6AAAAABKSRHCXGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBTHAZDKNQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[danielpeter]

hi Dorian & Barbara, thanks for providing more details!

i'm currently comparing this repo:
https://github.com/dosoe/Specfem3d_globe_7.0_Berkeley/tree/main
with this one:
https://github.com/dosoe/specfem3d_globe/tree/devel
and noticed that the SEMUCB model files provided in the corresponding data folders DATA/SEMUCB_A3d/ are different. which model files would be your preferred ones?

so far, the discrepancies that I see all come from the crustal mesh stretching, source positioning and the geographic to geocentric conversions of the old version versus the new one. I haven't been able though to run it with the full SEMUCB model, as it takes ages to finish the meshing part. There might also be some issue with the ATTENUATION_1D_WITH_3D_STORAGE flag - i would put this to .true. for now in the new version until I have it fully checked.

It's probably easiest if I start adding your model to the "official" devel version of SPECFEM3D_GLOBE together with a conversion flag to make these comparisons easier for you. for that purpose, I would add your preferred model SEMUCB_A3d/ files to the repo - just let me know which ones :)

[dosoe]

Hi Daniel,
I will double-check the issue of the models being different - that is probably just the version I uploaded, I have checked repeatedly that I run my tests on the same model.
As for the ATTENUATION_1D_WITH_3D_STORAGE flag, I have set it to .false. initially, as it is what we do in 7.0, but I have noticed that it creates a mismatch for 1D models, which is solved when setting it to .true. . This seems to only correct attenuation issues in for 1D models though, according to the tests run by Barbara.
Regards,
Dorian

[dosoe]

By the way, I'm not sure why this flag would create a mismatch for 1D models (when you run both with attenuation activated, of course), judging from the name it should just be about how the mesh is stored, not the mesh itself. Is that what it does?

[dosoe]

I just updated the SemUCB model files. They are identical now.

[dosoe]

When I run the mesher for SemUCB with the NEX and NPROC variables from the github (112 and 7 respectively) it runs in about 20 minutes. Does it take substantially more for you?

[dosoe]

Just to be clear, the model files in https://github.com/dosoe/specfem3d_globe/tree/devel are the correct ones for SemUCB

[barbara-brz]

Hi Daniel, Thanks a lot for your attention. I have checked that the 3D model that I used in the comparison figures that I sent is the same for the version 7 and version 8 runs. I am surprised you say the mesher takes forever to run, because my experience is similar to Dorian's, it takes no more than 15 mn on Anvil with NEX = 128 and NPROC = 8. ABout the ellipticity question: In short, our model (both crust and mantle) is referred to a spherical earth and we account for geographic to geocentric coordinate corrections and for ellipticity when building it. So when we compute synthetics in the SEM we need to first convert geographic to geocentric both for source and receiver, and ADD the theoretical ellipticity effect. Perhaps that needs to be done differently in version 7 and 8, but I'd be surprised if the large amplitude discrepancies come from an error on the ellipticity correction. Does this answer your question? The mesh stretching may be a better candidate, how is it implemented differently in version 8 compared to version 7? I've compared (but perhaps not enough) at the way it is done but haven't spotted any differences between the two versions yet...will try to look at it again, also with Dorian. regards Barbara

…

On Fri, Oct 4, 2024 at 1:22 PM Dorian Soergel ***@***.***> wrote: Just to be clear, the model files in https://github.com/dosoe/specfem3d_globe/tree/devel are the correct ones for SemUCB — Reply to this email directly, view it on GitHub <#1718 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BJEVZDMUTENMCVHXURTOKNLZZ32INAVCNFSM6AAAAABKSRHCXGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBUHAZTKNA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[danielpeter]

thanks for the ellipticity comment, Barbara! If I understand correctly, both crustal and mantle models are thus defining velocities with reference to geocentric latitude/longitude positions. that helps already to set up something correspondingly.

Dorian, one of the culprints I found in the new version is this line here in file model_berkeley.f90:

https://github.com/dosoe/specfem3d_globe/blob/41ac1a0e5bce77eca8b2752700d97a6c37381fc8/src/meshfem3D/model_berkeley.f90#L339

instead of

    real(kind=4) :: dvsv,dvsh,dvpv,dvph 

you need to define them now as

    double precision :: dvsv,dvsh,dvpv,dvph 

the real(kind=4) parameters have only been used for the S362ANI models in the past. to separate and distinguish these "special" kind parameters, they have been renamed to xdvsv,.. etc. in the new version. however, double precision :: dvsv,.. parameters are now also used for other models (e.g., the full spherical harmonic model) in the calling routine in file meshfem3D_models.F90. so, you can either change the definition in model_berkeley.f90 to double precision as stated above, or leave as is and change the calling routine to use xdvsv, xdvsh, xdvpv, xdvph for those instead. I would prefer the former and keep the single precision real(kind=4) parameters only for the S362ANI models.

try correcting this in the new version, and it should bring your match between versions much closer to each other.

most other differences I see are due to how the new version handles the geocentric/geographic conversions for ellipticity. I'll need to rewrite this a bit to allow different (crustal) models with different reference frames. for example, the CRUST1.0/2.0 models use geographic lat/lon positions, while yours is using geocentric lat/lon positions - something to rethink in the new version.

another even more subtle point would be to adjust the layer thicknesses when reading in and assigning crustal models that are referencing a geographic (elliptical) framework like the CRUST models. we assign the model velocities while the mesh is still spherical, and then stretch it out afterwards to account for the elliptical shape. this will affect the layer thicknesses slightly in the final mesh and we could in principle correct this such that the thicknesses in the final, elliptical mesh are exactly the ones as defined - this might have a minor effect and has been ignored till now - let me check. or maybe, I'm just wrong about the geographic reference frame of the CRUST1.0/2.0 models and we're all set already. I'll need to go through those model descriptions, again... :)

finally, regarding the speed of reading in the model, I'll see what I can do to speed it up. most models read much faster, so I'm not used to wait for so long until the mesher has finished. hopefully, there are some magic tricks like hash tables or precomputed factor arrays to make this fast, i'll check once the "initial" version has been added.

[barbara-brz]

Hi Daniel and Dorian, I think the problem is resolved and ***WE"RE DONE *** - no need to scratch our heads about any implementation of the 3D crust etc.. 1) I changed the line in model_berkeley.f90, but more importantly 2) I modified constants.h so that: logical, parameter :: ATTENUATION_1D_WITH_3D_STORAGE = .true. (I thought I had modified it earlier, but for some reason it did not register - my bad! that was the main problem from day 1 and Dorian only recently spotted it).. and the fit is now perfect! I attach a couple of examples at different distances here, but *Dorian will need to port them to the github and check whether things also work for a shallow event (mine is deep*):) Daniel: I hope you find the same with the version that Dorian sent you and we can officially declare that SEMUCB (and other models in Berkeley 's format) are now implemented in the latest version of SpecFEM, at least for CPU's. Regards Barbara

…

On Sun, Oct 6, 2024 at 1:09 PM daniel peter ***@***.***> wrote: thanks for the ellipticity comment, Barbara! If I understand correctly, both crustal and mantle models are thus defining velocities with reference to geocentric latitude/longitude positions. that helps already to set up something corresponding. Dorian, one of the culprints I found in the new version is this line here in file model_berkeley.f90: https://github.com/dosoe/specfem3d_globe/blob/41ac1a0e5bce77eca8b2752700d97a6c37381fc8/src/meshfem3D/model_berkeley.f90#L339 instead of real(kind=4) :: dvsv,dvsh,dvpv,dvph you need to define them now as double precision :: dvsv,dvsh,dvpv,dvph the real(kind=4) parameters have only been used for the S362ANI models in the past. to separate and distinguish these "special" kind parameters, they have been renamed to xdvsv,.. etc. in the new version. however, double precision :: dvsv,.. parameters are now also used for other models (e.g., the full spherical harmonic model) in the calling routine in file meshfem3D_models.F90. so, you can either change the definition in model_berkeley.f90 to double precision as stated above, or leave as is and change the calling routine to use xdvsv, xdvsh, xdvpv, xdvph for those instead. I would prefer the former and keep the single precision real(kind=4) parameters only for the S362ANI models. try correcting this in the new version, and it should bring your match between versions much closer to each other. most other differences I see are due to how the new version handles the geocentric/geographic conversions for ellipticity. I'll need to rewrite this a bit to allow different (crustal) models with different reference frames. for example, the CRUST1.0/2.0 models use geographic lat/lon positions, while yours is using geocentric lat/lon positions - something to rethink in the new version. another even more subtle point would be to adjust the layer thicknesses when reading in and assigning crustal models that are referencing a geographic (elliptical) framework like the CRUST models. we assign the model velocities while the mesh is still spherical, and then stretch it out afterwards to account for the elliptical shape. this will affect the layer thicknesses slightly in the final mesh and we could in principle correct this such that the thicknesses in the final, elliptical mesh are exactly the ones as defined - this might have a minor effect and has been ignored till now - let me check. or maybe, I'm just wrong about the geographic reference frame of the CRUST1.0/2.0 models and we're all set already. I'll need to go through those model descriptions, again... :) finally, regarding the speed of reading in the model, I'll see what I can do to speed it up. most models read much faster, so I'm not used to wait for so long until the mesher has finished. hopefully, there are some magic tricks like hash tables or precomputed factor arrays to make this fast, i'll check once the "initial" version has been added. — Reply to this email directly, view it on GitHub <#1718 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BJEVZDPGA5FM2744OIRFF6TZ2GKGRAVCNFSM6AAAAABKSRHCXGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBWGA3TMOA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[dosoe]

Here are the fits Barbara is talking about:
FFC_time_C20240128-new-corr.pdf
HRV_time_C20240128-new-corr.pdf
TAM_time_C20240128-new-corr.pdf
CAN_time_C20240128-new-corr.pdf

[danielpeter]

yes, that is one of the differences between new and old version. I'm currently running some tests with the newly added routines in the devel version and let you know about the progress - hopefully this will be fixed soon.

to avoid this lat/lon issue for the Berkeley crustal model I'll use the r/theta/phi positions as arguments which will always be geocentric positions.

[danielpeter]

ps. I noticed that the SEMUCB reference model defines transverse isotropy (eta parameter /= 1) for the whole mantle. however, the current implementation only considers tiso from the 220 discontinuity upwards to crust. do you prefer having tiso considered for the full mantle as default or keep the current treatment?

[dosoe]

Hi Daniel,
We have set USE_FULL_TISO_MANTLE to .true. and we have modified the compute_element_tiso_flag subroutine so that elem_is_tiso is always .true. in the mantle.

I believe using double precision in model_berkeley.f90 as you suggested earlier is responsible for most of the improvement, that was a really good catch!

This is the result of a run with all parameters enabled:

As can be seen, the fit is pretty good but not good enough that we could substitute one for the other , for example for doing tomography

To rule out effects of oceans, rotation and gravity, I have disabled all three, which doesn't solve anything as you can see here:

I manually disabled the geocentric to geographic correction when reading the crust (by hardcoding call thetaphi_2_geographic_latlon_dble(theta,phi,lat,lon,.false.) in meshfem3D_models_get3Dcrust_val, it's not the best way for long term but should work for quick testing), the results are so similar that I would need a magnifying glass to see any difference, in other worlds, it doesn't solve our problem:

I also thought it could be due to the topography correction (but kept the geocentric to geographic correction in the crust), but removing the topography makes the fit much worse. I don't know if it is a hint, maybe a similar typing error:

So this is the status of our attempts. I'm looking forward to see if your tests yield any helpful information.
Regards,
Dorian

[barbara-brz]

Hi Daniel, Dorian explained very clearly the status of our benchmarks. Just to clarify: SEMUCB is radially anisotropic across the whole mantle (and crust). This is how it's implemented in specfem ver. 7 and it seems Dorian did the necessary to account for that in the "current" version (i.e. not sure where you see that the anisotropy stops at 220 km?) regards Barbara

…

On Wed, Oct 9, 2024 at 5:55 PM Dorian Soergel ***@***.***> wrote: Hi Daniel, We have set USE_FULL_TISO_MANTLE to .true. and we have modified the compute_element_tiso_flag subroutine so that elem_is_tiso is always .true. in the mantle. I believe using double precision in model_berkeley.f90 as you suggested earlier is responsible for most of the improvement, that was a really good catch! This is the result of a run with all parameters enabled: B012796B_section_Z_synth_new_3D_semucb_full_alltrue.png (view on web) <https://github.com/user-attachments/assets/bdfeab20-0bb6-4eda-8c06-3341b2afee48> As can be seen, the fit is pretty good but not good enough that we could substitute one for the other , for example for doing tomography To rule out effects of oceans, rotation and gravity, I have disabled all three, which doesn't solve anything as you can see here: B012796B_section_Z_synth_new_3D_semucb_full_topo_ellip_att.png (view on web) <https://github.com/user-attachments/assets/76203b15-b9c5-4783-991a-5afb1f0a567d> I manually disabled the geocentric to geographic correction when reading the crust (by hardcoding call thetaphi_2_geographic_latlon_dble(theta,phi,lat,lon,.false.) in meshfem3D_models_get3Dcrust_val, it's not the best way for long term but should work for quick testing), the results are so similar that I would need a magnifying glass to see any difference, in other worlds, it doesn't solve our problem: B012796B_section_Z_synth_new_3D_semucb_full_alltrue_spherical_crust.png (view on web) <https://github.com/user-attachments/assets/82f610fb-4d04-4a42-adbd-78000ef23d77> I also thought it could be due to the topography correction (but kept the geocentric to geographic correction in the crust), but removing the topography makes the fit much worse. I don't know if it is a hint, maybe a similar typing error: B012796B_section_Z_synth_new_3D_semucb_full_ellip_att.png (view on web) <https://github.com/user-attachments/assets/51bcb381-1e96-4b8d-b092-ff371e7a6412> So this is the status of our attempts. I'm looking forward to see if your tests yield any helpful information. Regards, Dorian — Reply to this email directly, view it on GitHub <#1718 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BJEVZDL4CYMXNBCWJDDF24LZ2XF6TAVCNFSM6AAAAABKSRHCXGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOBZHAZDOMY> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[danielpeter]

okay great, I might have missed that somewhere - will add this as default. the devel version is nearly there, will update you soon...

[danielpeter]

Dorian & Barbara, you could now run a comparison with the latest devel version of SPECFEM3D_GLOBE. I added the SEMUCB_A3d model to compare with your older version(s).

for comparisons, you would turn on the following flag in file setup/constants.h:

  logical, parameter :: USE_OLD_VERSION_FORMAT = .true.

this should give you identical results as with version 7.0 (which is actually source code files from version 6.0, not 7.0). in the updated devel version, there is a corresponding section in the constants.h file, where you would set the following:

!!-----------------------------------------------------------
!!
!! for Berkeley model
!!
!!-----------------------------------------------------------

! source-time function is a UCB-style filtered heaviside
  logical, parameter :: STF_IS_UCB_HEAVISIDE = .true.

! Save mirror files
  logical, parameter :: SAVE_MIRRORS = .false.

! Path to A3d model
! Make sure this line ends on "/"
  character (len=*), parameter :: A3d_folder = "DATA/SEMUCB_A3d/"

! topography model
!!--- ETOPO1 5 - Berkeley filtered
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_BERKELEY = 360,NY_BATHY_BERKELEY = 181
! resolution of topography file in minutes
  integer, parameter :: RESOLUTION_TOPO_FILE_BERKELEY = 60
! pathname of the topography file (un-smoothed)
  character (len=*), parameter :: PATHNAME_TOPO_FILE_BERKELEY = trim(A3d_folder)//"ETOPO5_1x1_filtre.dat"

!! uncomment this to use Berkeley topography as default - and comment out corresponding parameters above !!
!! Topography defaults to Berkeley
  integer, parameter :: EARTH_NX_BATHY = NX_BATHY_BERKELEY
  integer, parameter :: EARTH_NY_BATHY = NY_BATHY_BERKELEY
  double precision, parameter :: EARTH_RESOLUTION_TOPO_FILE = RESOLUTION_TOPO_FILE_BERKELEY
  character (len=*), parameter :: EARTH_PATHNAME_TOPO_FILE = PATHNAME_TOPO_FILE_BERKELEY

apart from the SAVE_MIRRORS flag which lacks the source code files, the STF and topo features should be all working now. please let me know if you still find some discrepancies when comparing with the old version.

[dosoe]

Hi Daniel,
Thank you, I will run these comparisons end of this week.
Dorian

[dosoe]

Sorry, I thought I spotted something wrong, but I was wrong myself.

[barbara-brz]

Hi Daniel, Cool! regards Barbara

…

On Thu, Oct 10, 2024 at 3:18 PM Dorian Soergel ***@***.***> wrote: Hi Daniel, Thank you, I will run these comparisons end of this week. Dorian — Reply to this email directly, view it on GitHub <#1718 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BJEVZDMI7A2U74FLUQXXASTZ234KZAVCNFSM6AAAAABKSRHCXGVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTAOJQHEYTMNA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[danielpeter]

hi Dorian, these parameters are optional now. you can still put them into the Par_file in your run and they will override the default values when the UCB heaviside is turned on. On 11 Oct 2024, at 02:11, Dorian Soergel ***@***.***> wrote: Sorry, I thought I spotted something wrong, but I was wrong myself. —Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you were mentioned.Message ID: ***@***.***>

[dosoe]

Hi Daniel,
I just ran a comparison between the latest devel version of specfem (with semucb) and our old version of semucb. It does not match well.
Here it is if I don't activate USE_OLD_VERSION_FORMAT :

Here it is with USE_OLD_VERSION_FORMAT=.true.:

In either case, the fit is pretty bad.
I'm also attaching the constants.h and Par_file used in these runs, the only difference is in the value of USE_OLD_VERSION_FORMAT , maybe I missed something when it got reversed back to the defaults. I hope that's the case, actually, as that would be an easy fix.
Regards,
Dorian
Par_file:

#-----------------------------------------------------------
#
# Simulation input parameters
#
#-----------------------------------------------------------

# forward or adjoint simulation
SIMULATION_TYPE                 = 1   # set to 1 for forward simulations, 2 for adjoint simulations for sources, and 3 for kernel simulations
NOISE_TOMOGRAPHY                = 0   # flag of noise tomography, three steps (1,2,3). If earthquake simulation, set it to 0.
SAVE_FORWARD                    = .false.   # save last frame of forward simulation or not

# number of chunks (1,2,3 or 6)
NCHUNKS                         = 6

# angular width of the first chunk (not used if full sphere with six chunks)
ANGULAR_WIDTH_XI_IN_DEGREES     = 20.d0   # angular size of a chunk
ANGULAR_WIDTH_ETA_IN_DEGREES    = 20.d0
CENTER_LATITUDE_IN_DEGREES      = 40.d0
CENTER_LONGITUDE_IN_DEGREES     = 25.d0
GAMMA_ROTATION_AZIMUTH          = 0.d0

# number of elements at the surface along the two sides of the first chunk
# (must be multiple of 16 and 8 * multiple of NPROC below)
NEX_XI                          = 112
NEX_ETA                         = 112

# number of MPI processors along the two sides of the first chunk
NPROC_XI                        = 7
NPROC_ETA                       = 7

#-----------------------------------------------------------
#
# Model
#
#-----------------------------------------------------------

# 1D models with real structure:
# 1D_isotropic_prem, 1D_transversely_isotropic_prem, 1D_iasp91, 1D_1066a, 1D_ak135f_no_mud, 1D_ref, 1D_ref_iso, 1D_jp3d,1D_sea99
#
# 1D models with only one fictitious averaged crustal layer:
# 1D_isotropic_prem_onecrust, 1D_transversely_isotropic_prem_onecrust, 1D_iasp91_onecrust, 1D_1066a_onecrust, 1D_ak135f_no_mud_onecrust
#
# fully 3D models:
# transversely_isotropic_prem_plus_3D_crust_2.0, 3D_anisotropic, 3D_attenuation,
# s20rts, s40rts, s362ani, s362iso, s362wmani, s362ani_prem, s362ani_3DQ, s362iso_3DQ,
# s29ea, sea99_jp3d1994, sea99, jp3d1994, heterogen, full_sh, sgloberani_aniso, sgloberani_iso
#
# 3D crustal models:
# crust1.0, crust2.0, EPcrust, EuCRUST, crustmaps, crustSH
#
# Mars models:
# 1D_Sohl, 1D_Sohl_3D_crust, 1D_case65TAY, 1D_case65TAY_3D_crust, mars_1D, mars_1D_3D_crust
#
# Moon models:
# vpremoon
#
# 3D models with 3D crust: append "_**crustname**" to the mantle model name
#                          to take a 3D crustal model (by default crust2.0 is taken for 3D mantle models)
#                          e.g. s20rts_crust1.0, s362ani_crustmaps, full_sh_crustSH, sglobe_EPcrust, etc.
#
# 3D models with 1D crust: append "_1Dcrust" to the 3D model name
#                          to take the 1D crustal model from the
#                          associated reference model rather than the default 3D crustal model
#                          e.g. s20rts_1Dcrust, s362ani_1Dcrust, etc.
#
MODEL                           = semucb_a3d

# parameters describing the Earth model
OCEANS                          = .true.
ELLIPTICITY                     = .true.
TOPOGRAPHY                      = .true.
GRAVITY                         = .true.
ROTATION                        = .true.
ATTENUATION                     = .true.

# full gravity calculation by solving Poisson's equation for gravity potential instead of using a Cowling approximation
# (must have also GRAVITY flag set to .true. to become active)
FULL_GRAVITY                    = .false.
# for full gravity calculation, set to 0 == builtin or 1 == PETSc Poisson solver
# (the PETSc solver option needs the PETSc library installed; code configuration --with-petsc)
POISSON_SOLVER                  = 0

# record length in minutes
RECORD_LENGTH_IN_MINUTES        = 100.d0

# Source frequency content (i.e., heaviside function)
SOURCE_T1                       = 500.d0
SOURCE_T2                       = 400.d0
SOURCE_T3                       =  50.d0
SOURCE_T4                       =  40.d0

# Source time shift
TAU                             = 500.d0


#-----------------------------------------------------------
#
# Mesh
#
#-----------------------------------------------------------

## regional mesh cut-off
# using this flag will cut-off the mesh in the mantle at a layer matching to the given cut-off depth.
# this flag only has an effect for regional simulations, i.e., for NCHUNKS values less than 6.
REGIONAL_MESH_CUTOFF            = .false.

# regional mesh cut-off depth (in km)
# possible selections are: 24.4d0, 80.d0, 220.d0, 400.d0, 600.d0, 670.d0, 771.d0
REGIONAL_MESH_CUTOFF_DEPTH      = 400.d0

# regional mesh cut-off w/ a second doubling layer below 220km interface
# (by default, a first doubling layer will be added below the Moho, and a second one below the 771km-depth layer.
#  Setting this flag to .true., will move the second one below the 220km-depth layer for regional mesh cut-offs only.)
REGIONAL_MESH_ADD_2ND_DOUBLING  = .false.

#-----------------------------------------------------------
#
# Absorbing boundary conditions
#
#-----------------------------------------------------------

# absorbing boundary conditions for a regional simulation
ABSORBING_CONDITIONS            = .false.

# run global simulation for a circular region and apply high attenuation for the rest of the model
# this creates an absorbing boundary with less reflection than stacey at a cost of 6x the computational cost
# NCHUNKS must be set to 6 to enable this flag
ABSORB_USING_GLOBAL_SPONGE      = .false.

# location and size of the region with no sponge (the region to run simulation)
SPONGE_LATITUDE_IN_DEGREES      = 40.d0
SPONGE_LONGITUDE_IN_DEGREES     = 25.d0
SPONGE_RADIUS_IN_DEGREES        = 25.d0

#-----------------------------------------------------------
#
# undoing attenuation for sensitivity kernel calculations
#
#-----------------------------------------------------------

# to undo attenuation for sensitivity kernel calculations or forward runs with SAVE_FORWARD
# use one (and only one) of the two flags below. UNDO_ATTENUATION is much better (it is exact)
# but requires a significant amount of disk space for temporary storage.
PARTIAL_PHYS_DISPERSION_ONLY    = .true.
UNDO_ATTENUATION                = .false.

## undo attenuation memory
# How much memory (in GB) is installed on your machine per CPU core
# (only used for UNDO_ATTENUATION, can be ignored otherwise)
# Beware, this value MUST be given per core, i.e. per MPI thread, i.e. per MPI rank, NOT per node.
# This value is for instance:
#   -  4 GB on Tiger at Princeton
#   -  4 GB on TGCC Curie in Paris
#   -  4 GB on Titan at ORNL when using CPUs only (no GPUs); start your run with "aprun -n$NPROC -N8 -S4 -j1"
#   -  2 GB on the machine used by Christina Morency
#   -  2 GB on the TACC machine used by Min Chen
#   -  1.5 GB on the GPU cluster in Marseille
# When running on GPU machines, it is simpler to set PERCENT_OF_MEM_TO_USE_PER_CORE = 100.d0
# and then set MEMORY_INSTALLED_PER_CORE_IN_GB to the amount of memory that you estimate is free (rather than installed)
# on the host of the GPU card while running your GPU job.
# For GPU runs on Titan at ORNL, use PERCENT_OF_MEM_TO_USE_PER_CORE = 100.d0 and MEMORY_INSTALLED_PER_CORE_IN_GB = 25.d0
# and run your job with "aprun -n$NPROC -N1 -S1 -j1"
# (each host has 32 GB on Titan, each GPU has 6 GB, thus even if all the GPU arrays are duplicated on the host
#  this leaves 32 - 6 = 26 GB free on the host; leaving 1 GB for the Linux system, we can safely use 100% of 25 GB)
MEMORY_INSTALLED_PER_CORE_IN_GB = 4.d0
# What percentage of this total do you allow us to use for arrays to undo attenuation, keeping in mind that you
# need to leave some memory available for the GNU/Linux system to run
# (a typical value is 85%; any value below is fine but the code will then save a lot of data to disk;
#  values above, say 90% or 92%, can be OK on some systems but can make the adjoint code run out of memory
#  on other systems, depending on how much memory per node the GNU/Linux system needs for itself; thus you can try
#  a higher value and if the adjoint crashes then try again with a lower value)
PERCENT_OF_MEM_TO_USE_PER_CORE  = 85.d0

## exact mass matrices for rotation
# three mass matrices instead of one are needed to handle rotation very accurately;
# otherwise rotation is handled slightly less accurately (but still reasonably well);
# set to .true. if you are interested in precise effects related to rotation;
# set to .false. if you are solving very large inverse problems at high frequency and also undoing attenuation exactly
#
# using the UNDO_ATTENUATION flag above, in which case saving as much memory as possible can be a good idea.
# You can also safely set it to .false. if you are not in a period range in which rotation matters,
# e.g. if you are targetting very short-period body waves. if in doubt, set to .true.
#
# You can safeely set it to .true. if you have ABSORBING_CONDITIONS above, because in that case the code
# will use three mass matrices anyway and thus there is no additional memory cost.
# this flag is of course unused if ROTATION above is set to .false.
EXACT_MASS_MATRIX_FOR_ROTATION  = .false.

#-----------------------------------------------------------
#
# LDDRK time scheme
#
#-----------------------------------------------------------

# this for LDDRK high-order time scheme instead of Newmark
USE_LDDRK                       = .false.

# the maximum CFL of LDDRK is significantly higher than that of the Newmark scheme,
# in a ratio that is theoretically 1.327 / 0.697 = 1.15 / 0.604 = 1.903 for a solid with Poisson's ratio = 0.25
# and for a fluid (see the manual of the 2D code, SPECFEM2D, Tables 4.1 and 4.2, and that ratio does not
# depend on whether we are in 2D or in 3D). However in practice a ratio of about 1.5 to 1.7 is often safer
# (for instance for models with a large range of Poisson's ratio values).
# Since the code computes the time step using the Newmark scheme, for LDDRK we will simply
# multiply that time step by this ratio when LDDRK is on and when flag INCREASE_CFL_FOR_LDDRK is true.
INCREASE_CFL_FOR_LDDRK          = .true.
RATIO_BY_WHICH_TO_INCREASE_IT   = 1.5d0

#-----------------------------------------------------------
#
# Visualization
#
#-----------------------------------------------------------

# save AVS or OpenDX movies
#MOVIE_COARSE saves movie only at corners of elements (SURFACE OR VOLUME)
#MOVIE_COARSE does not work with create_movie_AVS_DX
MOVIE_SURFACE                   = .false.
MOVIE_VOLUME                    = .false.
MOVIE_COARSE                    = .true.
NTSTEP_BETWEEN_FRAMES           = 50
HDUR_MOVIE                      = 0.d0

# save movie in volume.  Will save element if center of element is in prescribed volume
# top/bottom: depth in KM, use MOVIE_TOP = -100 to make sure the surface is stored.
# west/east: longitude, degrees East [-180/180] top/bottom: latitute, degrees North [-90/90]
# start/stop: frames will be stored at MOVIE_START + i*NSTEP_BETWEEN_FRAMES, where i=(0,1,2..) and iNSTEP_BETWEEN_FRAMES <= MOVIE_STOP
# movie_volume_type: 1=strain, 2=time integral of strain, 3=\mu*time integral of strain
# type 4 saves the trace and deviatoric stress in the whole volume, 5=displacement, 6=velocity
MOVIE_VOLUME_TYPE               = 2
MOVIE_TOP_KM                    = -100.0
MOVIE_BOTTOM_KM                 = 1000.0
MOVIE_WEST_DEG                  = -90.0
MOVIE_EAST_DEG                  = 90.0
MOVIE_NORTH_DEG                 = 90.0
MOVIE_SOUTH_DEG                 = -90.0
MOVIE_START                     = 0
MOVIE_STOP                      = 40000

# save mesh files to check the mesh
SAVE_MESH_FILES                 = .true.

# restart files (number of runs can be 1 or higher, choose 1 for no restart files)
NUMBER_OF_RUNS                  = 1
NUMBER_OF_THIS_RUN              = 1

# path to store the local database files on each node
LOCAL_PATH                      = ./DATABASES_MPI
# temporary wavefield/kernel/movie files
LOCAL_TMP_PATH                  = ./DATABASES_MPI

# interval at which we output time step info and max of norm of displacement
NTSTEP_BETWEEN_OUTPUT_INFO      = 500

#-----------------------------------------------------------
#
# Sources
#
#-----------------------------------------------------------

# use a (tilted) FORCESOLUTION force point source (or several) instead of a CMTSOLUTION moment-tensor source.
# This can be useful e.g. for asteroid simulations
# in which the source is a vertical force, normal force, tilted force, impact etc.
# If this flag is turned on, the FORCESOLUTION file must be edited by giving:
# - the corresponding time-shift parameter,
# - the half duration parameter of the source,
# - the coordinates of the source,
# - the source time function of the source,
# - the magnitude of the force source,
# - the components of a (non necessarily unitary) direction vector for the force source in the E/N/Z_UP basis.
# The direction vector is made unitary internally in the code and thus only its direction matters here;
# its norm is ignored and the norm of the force used is the factor force source times the source time function.
USE_FORCE_POINT_SOURCE          = .false.

# use monochromatic source time function for CMTSOLUTION moment-tensor source.
# half duration is interpreted as a PERIOD just to avoid changing CMTSOLUTION file format
# default is .false. which uses Heaviside function
USE_MONOCHROMATIC_CMT_SOURCE    = .false.

# print source time function
PRINT_SOURCE_TIME_FUNCTION      = .false.

#-----------------------------------------------------------
#
# Seismograms
#
#-----------------------------------------------------------

# interval in time steps for temporary writing of seismograms
NTSTEP_BETWEEN_OUTPUT_SEISMOS   = 5000000

# set to n to reduce the sampling rate of output seismograms by a factor of n
# defaults to 1, which means no down-sampling
NTSTEP_BETWEEN_OUTPUT_SAMPLE    = 1

# option to save strain seismograms
# this option is useful for strain Green's tensor
# this feature is currently under development
SAVE_SEISMOGRAMS_STRAIN         = .false.

# save seismograms also when running the adjoint runs for an inverse problem
# (usually they are unused and not very meaningful, leave this off in almost all cases)
SAVE_SEISMOGRAMS_IN_ADJOINT_RUN = .false.

# output format for the seismograms (one can use either or all of the three formats)
OUTPUT_SEISMOS_ASCII_TEXT       = .true.
OUTPUT_SEISMOS_SAC_ALPHANUM     = .false.
OUTPUT_SEISMOS_SAC_BINARY       = .false.
OUTPUT_SEISMOS_ASDF             = .false.
OUTPUT_SEISMOS_3D_ARRAY         = .false.

# rotate seismograms to Radial-Transverse-Z or use default North-East-Z reference frame
ROTATE_SEISMOGRAMS_RT           = .false.

# decide if main process writes all the seismograms or if all processes do it in parallel
WRITE_SEISMOGRAMS_BY_MAIN       = .false.

# save all seismograms in one large combined file instead of one file per seismogram
# to avoid overloading shared non-local file systems such as LUSTRE or GPFS for instance
SAVE_ALL_SEISMOS_IN_ONE_FILE    = .false.
USE_BINARY_FOR_LARGE_FILE       = .false.

# flag to impose receivers at the surface or allow them to be buried
RECEIVERS_CAN_BE_BURIED         = .true.

#-----------------------------------------------------------
#
#  Adjoint kernel outputs
#
#-----------------------------------------------------------

# interval in time steps for reading adjoint traces
# 0 = read the whole adjoint sources at start time
NTSTEP_BETWEEN_READ_ADJSRC      = 0

# use ASDF format for reading the adjoint sources
READ_ADJSRC_ASDF                = .false.

# this parameter must be set to .true. to compute anisotropic kernels
# in crust and mantle (related to the 21 Cij in geographical coordinates)
# default is .false. to compute isotropic kernels (related to alpha and beta)
ANISOTROPIC_KL                  = .false.

# output only transverse isotropic kernels (alpha_v,alpha_h,beta_v,beta_h,eta,rho)
# rather than fully anisotropic kernels when ANISOTROPIC_KL above is set to .true.
# means to save radial anisotropic kernels, i.e., sensitivity kernels for beta_v, beta_h, etc.
SAVE_TRANSVERSE_KL_ONLY         = .false.

# output only the kernels used for the current azimuthally anisotropic inversions of surface waves,
# i.e., bulk_c, bulk_betav, bulk_betah, eta, Gc_prime, Gs_prime and rho
# (Gc' & Gs' which are the normalized Gc & Gs kernels by isotropic \rho\beta of the 1D reference model)
SAVE_AZIMUTHAL_ANISO_KL_ONLY    = .false.

# output approximate Hessian in crust mantle region.
# means to save the preconditioning for gradients, they are cross correlations between forward and adjoint accelerations.
APPROXIMATE_HESS_KL             = .false.

# forces transverse isotropy for all mantle elements
# (default is to use transverse isotropy only between crust and 220)
# means we allow radial anisotropy throughout the whole crust/mantle region
USE_FULL_TISO_MANTLE            = .true.

# output kernel mask to zero out source region
# to remove large values near the sources in the sensitivity kernels
SAVE_SOURCE_MASK                = .false.

# output kernels on a regular grid instead of on the GLL mesh points (a bit expensive)
SAVE_REGULAR_KL                 = .false.

# compute steady state kernels for source encoding
STEADY_STATE_KERNEL             = .false.
STEADY_STATE_LENGTH_IN_MINUTES  = 0.d0

#-----------------------------------------------------------

# Dimitri Komatitsch, July 2014, CNRS Marseille, France:
# added the ability to run several calculations (several earthquakes)
# in an embarrassingly-parallel fashion from within the same run;
# this can be useful when using a very large supercomputer to compute
# many earthquakes in a catalog, in which case it can be better from
# a batch job submission point of view to start fewer and much larger jobs,
# each of them computing several earthquakes in parallel.
# To turn that option on, set parameter NUMBER_OF_SIMULTANEOUS_RUNS to a value greater than 1.
# To implement that, we create NUMBER_OF_SIMULTANEOUS_RUNS MPI sub-communicators,
# each of them being labeled "my_local_mpi_comm_world", and we use them
# in all the routines in "src/shared/parallel.f90", except in MPI_ABORT() because in that case
# we need to kill the entire run.
# When that option is on, of course the number of processor cores used to start
# the code in the batch system must be a multiple of NUMBER_OF_SIMULTANEOUS_RUNS,
# all the individual runs must use the same number of processor cores,
# which as usual is NPROC in the Par_file,
# and thus the total number of processor cores to request from the batch system
# should be NUMBER_OF_SIMULTANEOUS_RUNS * NPROC.
# All the runs to perform must be placed in directories called run0001, run0002, run0003 and so on
# (with exactly four digits).
#
# Imagine you have 10 independent calculations to do, each of them on 100 cores; you have three options:
#
# 1/ submit 10 jobs to the batch system
#
# 2/ submit a single job on 1000 cores to the batch, and in that script create a sub-array of jobs to start 10 jobs,
# each running on 100 cores (see e.g. http://www.schedmd.com/slurmdocs/job_array.html )
#
# 3/ submit a single job on 1000 cores to the batch, start SPECFEM3D on 1000 cores, create 10 sub-communicators,
# cd into one of 10 subdirectories (called e.g. run0001, run0002,... run0010) depending on the sub-communicator
# your MPI rank belongs to, and run normally on 100 cores using that sub-communicator.
#
# The option below implements 3/.
#
NUMBER_OF_SIMULTANEOUS_RUNS     = 1

# if we perform simultaneous runs in parallel, if only the source and receivers vary between these runs
# but not the mesh nor the model (velocity and density) then we can also read the mesh and model files
# from a single run in the beginning and broadcast them to all the others; for a large number of simultaneous
# runs for instance when solving inverse problems iteratively this can DRASTICALLY reduce I/Os to disk in the solver
# (by a factor equal to NUMBER_OF_SIMULTANEOUS_RUNS), and reducing I/Os is crucial in the case of huge runs.
# Thus, always set this option to .true. if the mesh and the model are the same for all simultaneous runs.
# In that case there is no need to duplicate the mesh and model file database (the content of the DATABASES_MPI
# directories) in each of the run0001, run0002,... directories, it is sufficient to have one in run0001
# and the code will broadcast it to the others)
BROADCAST_SAME_MESH_AND_MODEL   = .false.

#-----------------------------------------------------------

# set to true to use GPUs
GPU_MODE                        = .false.
# Only used if GPU_MODE = .true. :
GPU_RUNTIME                     = 1
# 2 (OpenCL), 1 (Cuda) ou 0 (Compile-time -- does not work if configured with --with-cuda *AND* --with-opencl)
GPU_PLATFORM                    = NVIDIA
GPU_DEVICE                      = Tesla

# set to true to use the ADIOS library for I/Os
ADIOS_ENABLED                   = .false.
ADIOS_FOR_FORWARD_ARRAYS        = .true.
ADIOS_FOR_MPI_ARRAYS            = .true.
ADIOS_FOR_ARRAYS_SOLVER         = .true.
ADIOS_FOR_SOLVER_MESHFILES      = .true.
ADIOS_FOR_AVS_DX                = .true.
ADIOS_FOR_KERNELS               = .true.
ADIOS_FOR_MODELS                = .true.
ADIOS_FOR_UNDO_ATTENUATION      = .true.

and constants.h:

!=====================================================================
!
!                       S p e c f e m 3 D  G l o b e
!                       ----------------------------
!
!     Main historical authors: Dimitri Komatitsch and Jeroen Tromp
!                        Princeton University, USA
!                and CNRS / University of Marseille, France
!                 (there are currently many more authors!)
! (c) Princeton University and CNRS / University of Marseille, April 2014
!
! This program is free software; you can redistribute it and/or modify
! it under the terms of the GNU General Public License as published by
! the Free Software Foundation; either version 3 of the License, or
! (at your option) any later version.
!
! This program is distributed in the hope that it will be useful,
! but WITHOUT ANY WARRANTY; without even the implied warranty of
! MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
! GNU General Public License for more details.
!
! You should have received a copy of the GNU General Public License along
! with this program; if not, write to the Free Software Foundation, Inc.,
! 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
!
!=====================================================================

! setup/constants.h.  Generated from constants.h.in by configure.

!
!--- user can modify parameters below
!

!
! solver in single or double precision depending on the machine (4 or 8 bytes)
!
!  ALSO CHANGE FILE precision.h ACCORDINGLY
!
  integer, parameter :: SIZE_REAL = 4, SIZE_DOUBLE = 8

! usually the size of integer and logical variables is the same as regular single-precision real variable
  integer, parameter :: SIZE_INTEGER = SIZE_REAL
  integer, parameter :: SIZE_LOGICAL = SIZE_REAL

! set to SIZE_REAL to run in single precision
! set to SIZE_DOUBLE to run in double precision (increases memory size by 2)
  integer, parameter :: CUSTOM_REAL = SIZE_REAL

!*********************************************************************************************************

!!-----------------------------------------------------------
!!
!! Gauss-Lobatto-Legendre resolution
!!
!!-----------------------------------------------------------
! number of GLL points in each direction of an element (degree plus one)
  integer, parameter :: NGLLX = 5
  integer, parameter :: NGLLY = NGLLX
  integer, parameter :: NGLLZ = NGLLX


!!-----------------------------------------------------------
!!
!! Energy
!!
!!-----------------------------------------------------------
!! added this temporarily here to make SPECFEM3D and SPECFEM3D_GLOBE much more similar
!! in terms of the structure of their main time iteration loop; these are future features
!! that are missing in this code but implemented in the other and that could thus be cut and pasted one day
  logical, parameter :: OUTPUT_ENERGY = .false.
  integer, parameter :: IOUT_ENERGY = 937  ! file number for the energy file
  logical, parameter :: GRAVITY_SIMULATION = .false.


!!-----------------------------------------------------------
!!
!! new version compatibility
!!
!!-----------------------------------------------------------
! for comparison against older versions
! in version 7.0: tiso was constrained to below moho, new version allows also in crust
! in version 8.0: conversions between geodetic & geocentric latitudes were always applied,
!                 and additional differences in 1-chunk centering & source positioning
  logical, parameter :: USE_OLD_VERSION_FORMAT = .false.


!!-----------------------------------------------------------
!!
!! I/O
!!
!!-----------------------------------------------------------

! if files on a local path on each node are also seen as global with same path
! set to .true. typically on a machine with a common (shared) file system, e.g. LUSTRE, GPFS or NFS-mounted /home
! set to .false. typically on a cluster of nodes with local disks used to store the mesh (not very common these days)
! if running on a cluster of nodes with local disks, also customize global path
! to local files in create_serial_name_database.f90 ("20 format ...")
! Flag is used only when one checks the mesh with the serial codes
! ("xcheck_buffers_1D" etc.), ignore it if you do not plan to use them
  logical, parameter :: LOCAL_PATH_IS_ALSO_GLOBAL = .true.

! maximum length of strings used for paths, reading from files, etc.
  integer, parameter :: MAX_STRING_LEN = 512

! input, output and main MPI I/O files
! note: careful with these unit numbers, we mostly use units in the 40-50 range.
!       Cray Fortran e.g. reserves 0,5,6 (standard error,input,output units) and 100,101,102 (input,output,error unit)
  integer, parameter :: ISTANDARD_OUTPUT = 6     ! or for cray: 101
! I/O unit for file input,output
  integer, parameter :: IIN = 40,IOUT = 41
! uncomment this to write messages to a text file
  integer, parameter :: IMAIN = 42
! uncomment this to write messages to the screen (slows down the code)
! integer, parameter :: IMAIN = ISTANDARD_OUTPUT

! I/O unit for noise data files
  integer, parameter :: IIN_NOISE = 43,IOUT_NOISE = 44
! I/O unit for adjoint source files
  integer, parameter :: IIN_ADJ = 45
! local file unit for output of buffers
  integer, parameter :: IOUT_BUFFERS = 46
! I/O unit for source and receiver vtk file
  integer, parameter :: IOUT_VTK = 47
! I/O unit for sac files
  integer, parameter :: IOUT_SAC = 48

!!-----------------------------------------------------------
!!
!! Earth
!!
!!-----------------------------------------------------------
! EARTH_R is the radius of the bottom of the oceans (radius of Earth in m)
  double precision, parameter :: EARTH_R = 6371000.d0
! uncomment line below for PREM with oceans
! double precision, parameter :: EARTH_R = 6368000.d0

! radius of the Earth in km
  double precision, parameter :: EARTH_R_KM = EARTH_R / 1000.d0

! average density in the full Earth to normalize equation
  double precision, parameter :: EARTH_RHOAV = 5514.3d0

!!-----------------------------------------------------------
!!
!! for topography/bathymetry model
!!
!!-----------------------------------------------------------
!--- ETOPO5 5-minute model, smoothed Harvard version (not provided in package, see DATA/topo_bathy/ for more infos)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_5 = 4320,NY_BATHY_5 = 2160
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_5 = 5.0
! pathname of the topography file
  character (len=*), parameter :: PATHNAME_TOPO_FILE_5 = &
    'DATA/topo_bathy/topo_bathy_etopo5_smoothed_Harvard.dat'

!---  ETOPO4 4-minute model (default)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_4 = 5400,NY_BATHY_4 = 2700
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_4 = 4.0
! pathname of the topography file
! character (len=*), parameter :: PATHNAME_TOPO_FILE_4 = &
!    'DATA/topo_bathy/topo_bathy_etopo4_from_etopo2_subsampled.bin'
  character (len=*), parameter :: PATHNAME_TOPO_FILE_4 = &
    'DATA/topo_bathy/topo_bathy_etopo4_smoothed_window_7.bin'

!--- ETOPO2 2-minute model (not provided in package, see DATA/topo_bathy/ for more infos)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_2 = 10800,NY_BATHY_2 = 5400
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_2 = 2.0
! pathname of the topography file
! character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
!    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_resampled_at_2minutes_original_unmodified_unsmoothed.bin'
! character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
!    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_resampled_at_2minutes_smoothed_window_3.bin'
! character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
!    'DATA/topo_bathy/topo_bathy_etopo2v2c_original_unmodified_unsmoothed.bin'
  character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
    'DATA/topo_bathy/topo_bathy_etopo2v2c_smoothed_window_3.bin'

!--- ETOPO1 1-minute model (not provided in package, see DATA/topo_bathy/ for more infos)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_1 = 21600,NY_BATHY_1 = 10800
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_1 = 1.0
! pathname of the topography file
!  character (len=*), parameter :: PATHNAME_TOPO_FILE_1 = &
!    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_original_unmodified_unsmoothed.bin'
  character (len=*), parameter :: PATHNAME_TOPO_FILE_1 = &
    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_smoothed_window_3.bin'

!!--- Default
! Topography defaults to ETOPO4
!  integer, parameter :: EARTH_NX_BATHY = NX_BATHY_4
!  integer, parameter :: EARTH_NY_BATHY = NY_BATHY_4
!  double precision, parameter :: EARTH_RESOLUTION_TOPO_FILE = RESOLUTION_TOPO_FILE_4
!  character (len=*), parameter :: EARTH_PATHNAME_TOPO_FILE = PATHNAME_TOPO_FILE_4

! For the reference ellipsoid to convert geographic latitudes to geocentric:
!
! From Dahlen and Tromp (1998): "Spherically-symmetric Earth models all have the same hydrostatic
! surface ellipticity 1/299.8. This is 0.5 percent smaller than observed flattening of best-fitting ellipsoid 1/298.3.
! The discrepancy is referred to as the "excess equatorial bulge of the Earth",
! an early discovery of artificial satellite geodesy."
!
! From Paul Melchior, IUGG General Assembly, Vienna, Austria, August 1991 Union lecture,
! available at http://www.agu.org/books/sp/v035/SP035p0047/SP035p0047.pdf :
! "It turns out that the spheroidal models constructed on the basis of the spherically-symmetric models (PREM, 1066A)
! by using the Clairaut differential equation to calculate the flattening in function of the radius vector imply hydrostaticity.
! These have surface ellipticity 1/299.8 and a corresponding dynamical flattening of .0033 (PREM).
! The actual ellipticty of the Earth for a best-fitting ellipsoid is 1/298.3 with a corresponding dynamical flattening of .0034."
!
! Thus, flattening f = 1/299.8 is what is used in SPECFEM3D_GLOBE, as it should.
! And thus eccentricity squared e^2 = 1 - (1-f)^2 = 1 - (1 - 1/299.8)^2 = 0.00665998813529,
! and the correction factor used in the code to convert geographic latitudes to geocentric
! is 1 - e^2 = (1-f)^2 = (1 - 1/299.8)^2 = 0.9933400118647.
!
! As a comparison, the classical World Geodetic System reference ellipsoid WGS 84
! (see e.g. http://en.wikipedia.org/wiki/World_Geodetic_System) has f = 1/298.2572236.
  double precision, parameter :: EARTH_FLATTENING_F = 1.d0 / 299.8d0
  double precision, parameter :: EARTH_ONE_MINUS_F_SQUARED = (1.d0 - EARTH_FLATTENING_F)**2

! Use GLL points to capture TOPOGRAPHY and ELLIPTICITY (experimental feature, currently does not work, DO NOT USE)
  logical, parameter :: USE_GLL = .false.

! the code will print an error message and stop if it finds that the topography input file
! contains values outside this range.
! we take a safety margin just in case of a smoothed or modified model, which can locally create slightly different values
  integer, parameter :: EARTH_TOPO_MINIMUM = - 11200 ! (max depth in m, Mariana trench)
  integer, parameter :: EARTH_TOPO_MAXIMUM = + 9000 ! (height in m, Mount Everest)

! minimum thickness in meters to include the effect of the oceans and topo
  double precision, parameter :: MINIMUM_THICKNESS_3D_OCEANS = 50.d0

! plots pnm-image (showing used topography)
! file can become fairly big for large topo-files, e.g. ETOPO1 creates a ~2.7 GB pnm-image
  logical,parameter :: PLOT_PNM_IMAGE_TOPO_BATHY = .false.


!!-----------------------------------------------------------
!!
!! for Berkeley model
!!
!!-----------------------------------------------------------

! source-time function is a UCB-style filtered heaviside
  logical, parameter :: STF_IS_UCB_HEAVISIDE = .true.

! Save mirror files
  logical, parameter :: SAVE_MIRRORS = .false.

! Path to A3d model
! Make sure this line ends on "/"
  character (len=*), parameter :: A3d_folder = "DATA/SEMUCB_A3d/"

! topography model
!!--- ETOPO1 5 - Berkeley filtered
! size of topography and bathymetry file
! note: NX = 360     to match longitude range [0,360[ , i.e., 0,1,2,..,359
!       NY = 180 + 1 to match colatitude range [0,180], i.e., 0,1,2,..,180
  integer, parameter :: NX_BATHY_BERKELEY = 360,NY_BATHY_BERKELEY = 181
! resolution of topography file in minutes (1 degree == 60 minutes)
  integer, parameter :: RESOLUTION_TOPO_FILE_BERKELEY = 60
! pathname of the topography file (un-smoothed)
  character (len=*), parameter :: PATHNAME_TOPO_FILE_BERKELEY = trim(A3d_folder)//"ETOPO5_1x1_filtre.dat"

!! uncomment this to use Berkeley topography as default - and comment out corresponding parameters above !!
!! Topography defaults to Berkeley
  integer, parameter :: EARTH_NX_BATHY = NX_BATHY_BERKELEY
  integer, parameter :: EARTH_NY_BATHY = NY_BATHY_BERKELEY
  double precision, parameter :: EARTH_RESOLUTION_TOPO_FILE = RESOLUTION_TOPO_FILE_BERKELEY
  character (len=*), parameter :: EARTH_PATHNAME_TOPO_FILE = PATHNAME_TOPO_FILE_BERKELEY


!!-----------------------------------------------------------
!!
!! for crustal model
!!
!!-----------------------------------------------------------
!! (uncomment desired model)

! crustal model cap smoothing - extension range in degree
! note: using a smaller range, e.g. 0.5 degrees, leads to undefined Jacobian error at different places.
!       this is probably due to stretching elements below sharp gradients, especially with deep moho values.
!       so far, the only thing that works is to smooth out values and take special care of the Andes...
! TODO: one could try to adapt this degree range to the simulation resolution in the future
  double precision, parameter :: CAP_SMOOTHING_DEGREE_DEFAULT = 1.0d0

! increase smoothing for critical regions (for instance high mountains in Europe and in the Andes) to increases mesh stability
  logical, parameter :: SMOOTH_CRUST_EVEN_MORE = .true.

! use sedimentary layers in crustal model
  logical, parameter :: INCLUDE_SEDIMENTS_IN_CRUST = .true.
  logical, parameter :: INCLUDE_ICE_IN_CRUST       = .false. ! always set this to false except for gravity integral calculations
  double precision, parameter :: MINIMUM_SEDIMENT_THICKNESS = 2.d0 ! minimim thickness in km


!!-----------------------------------------------------------
!!
!! source/receiver setup
!!
!!-----------------------------------------------------------

! flag to exclude elements that are too far from target in source detection
  logical, parameter :: USE_DISTANCE_CRITERION = .true.

! flag to display detailed information about location of stations
  logical, parameter :: DISPLAY_DETAILS_STATIONS = .false.

! maximum length of station and network name for receivers
  integer, parameter :: MAX_LENGTH_STATION_NAME = 32
  integer, parameter :: MAX_LENGTH_NETWORK_NAME = 8

! we mimic a triangle of half duration equal to half_duration_triangle
! using a Gaussian having a very close shape, as explained in Figure 4.2
! of the manual. This source decay rate to mimic an equivalent triangle
! was found by trial and error
  double precision, parameter :: SOURCE_DECAY_MIMIC_TRIANGLE = 1.628d0

! maximum number of sources and receivers to locate simultaneously
  integer, parameter :: NSOURCES_SUBSET_MAX = 100
  integer, parameter :: NREC_SUBSET_MAX = 200

! use this t0 as earliest starting time rather than the automatically calculated one
! (must be positive and bigger than the automatically one to be effective;
!  simulation will start at t = - t0)
  double precision, parameter :: USER_T0 = 0.0d0

! distance threshold (in km) above which we consider that a receiver
! is located outside the mesh and therefore excluded from the station list
  double precision, parameter :: THRESHOLD_EXCLUDE_STATION = 5.d0

! This parameter flags whether or not we will use an external source
! time function. Set to false by default.
  logical, parameter :: EXTERNAL_SOURCE_TIME_FUNCTION = .false.

! This parameter determines the taper length of monochromatic source time function in seconds
  double precision, parameter :: TAPER_MONOCHROMATIC_SOURCE = 200.0d0

!!-----------------------------------------------------------
!!
!! for sponge absorbing boundary
!!
!!-----------------------------------------------------------

! decay factor at the point farthest from the boundary
  double precision, parameter :: SPONGE_MIN_Q = 30.d0

! width of the region that transits from zero attenuation to full attenuation
  double precision, parameter :: SPONGE_WIDTH_IN_DEGREES = 15.d0

!!-----------------------------------------------------------
!!
!! for attenuation
!!
!!-----------------------------------------------------------
! note: We compute a constant Q behavior over a frequency absorption-band using a series of standard linear solids (SLS).
!       The absorption-band limits are determined by the maximum frequency (or minimum period) resolved by the mesh.
!       We shift the velocities to the logarithmic center frequency of this simulation frequency absorption-band,
!       accounting for physical dispersion effects of the Q model, assuming that the provided velocity model values
!       refer to a reference frequency f0 specified below.

! reference frequency of anelastic model
! by default, we use PREM values at 1 Hz
  double precision, parameter :: ATTENUATION_f0_REFERENCE = 1.d0   ! in Hz

! saves velocity model files shifted to the center frequency of the simulation attenuation period band
  logical, parameter :: ATTENUATION_SAVE_MODEL_AT_SHIFTED_CENTER_FREQ = .false.

! in the case of 1D attenuation models, use NGLL^3 storage of the attenuation constants in each GLL spectral element anyway
! (always safe to leave that to true; in the case of 1D attenuation models, setting it to false can save some memory storage)
  logical, parameter :: ATTENUATION_1D_WITH_3D_STORAGE  = .true.

!!-----------------------------------------------------------
!!
!! noise simulations
!!
!!-----------------------------------------------------------

! noise buffer for file i/o
! maximum noise buffer size in MB (will be used to evaluate number of steps for buffer, when UNDO_ATTENUATION == .false.)
! good performance results obtained for buffer sizes ~ 150 MB
  double precision,parameter :: MAXIMUM_NOISE_BUFFER_SIZE_IN_MB = 150.d0


!!-----------------------------------------------------------
!!
!! mesh optimization
!!
!!-----------------------------------------------------------

! maximum number of chunks (full sphere)
  integer, parameter :: NCHUNKS_MAX = 6

! Courant number for time step suggestion
! (empirical choice for distorted elements to estimate time step)
  double precision,parameter :: COURANT_SUGGESTED = 0.55d0

! number of points per minimum wavelength for minimum period estimate
  integer,parameter :: NPTS_PER_WAVELENGTH = 5

! the first doubling is implemented right below the Moho
! it seems optimal to implement the three other doublings at these depths
! in the mantle
  double precision, parameter :: EARTH_DEPTH_SECOND_DOUBLING_OPTIMAL = 1650000.d0
! in the outer core
  double precision, parameter :: EARTH_DEPTH_THIRD_DOUBLING_OPTIMAL  = 3860000.d0
! in the outer core
  double precision, parameter :: EARTH_DEPTH_FOURTH_DOUBLING_OPTIMAL = 5000000.d0

! to suppress element stretching for 3D moho surface
  logical,parameter :: SUPPRESS_MOHO_STRETCHING = .false.

! to suppress element stretching at 410/660 internal topography
! (i.e. creates mesh without 410/660 topography for Harvard model (s362ani,..))
  logical,parameter :: SUPPRESS_INTERNAL_TOPOGRAPHY = .false.

! by default, SAVE_MESH_FILES will use VTK formats; this will also output additional AVS_DX format files
  logical,parameter :: SAVE_MESHFILES_AVS_DX_FORMAT = .false.

!!-----------------------------------------------------------
!!
!! GPU optimization
!!
!!-----------------------------------------------------------
! added these parameters for the GPU version of the solver

! asynchronuous memcopy between CPU and GPU
  logical, parameter :: GPU_ASYNC_COPY = .true.

! mesh coloring
! add mesh coloring for the GPU + MPI implementation
! this is needed on NVIDIA hardware up to FERMI boards, included.
! Starting on KEPLER boards you can leave it off because on KEPLER hardware
! or higher atomic reduction operations have become as fast as resorting to mesh coloring.
  logical, parameter :: USE_MESH_COLORING_GPU = .false.
  integer, parameter :: MAX_NUMBER_OF_COLORS = 1000
! enhanced coloring:
! using Droux algorithm
! try several times with one more color before giving up
  logical, parameter :: USE_DROUX_OPTIMIZATION = .false.
  integer, parameter :: MAX_NB_TRIES_OF_DROUX_1993 = 15
! using balancing algorithm
! postprocess the colors to balance them if Droux (1993) algorithm is not used
  logical, parameter :: BALANCE_COLORS_SIMPLE_ALGO = .true.


!!-----------------------------------------------------------
!!
!! ADIOS Related values
!!
!!-----------------------------------------------------------

! for undo_att snapshots
! use only one file for all steps or a single file per iteration step
  logical, parameter :: ADIOS_SAVE_ALL_SNAPSHOTS_IN_ONE_FILE = .true.

! type selection to use compression operation before saving undo_att forward snapshot arrays
! compression algorithm: 0 == none / 1 == ZFP compression / 2 == SZ compression (needs to be supported by ADIOS2 library)
  integer, parameter :: ADIOS_COMPRESSION_ALGORITHM = 0     ! (default none)

!! ZFP compression
! mode options: see https://zfp.readthedocs.io/en/release0.5.5/modes.html
! parameters: 'rate'      w/ value '8'    - fixed-rate mode: choose values between ~8-20, higher for better accuracy
!             'accuracy'  w/ value '0.01' - fixed-accuracy mode: choose smaller value for better accuracy
!             'precision' w/ value '10'   - fixed-precision mode: choose between ~10-50, higher for better accuracy
!                                           (https://www.osti.gov/pages/servlets/purl/1572236)
!
! test setup: global simulation (s362ani model), NEX=160, ADIOS 2.5.0
!             duration 30 min, 9 snapshot files (w/ estimated total size 117.6 GB)
! - {'rate','8'} leads to a rather constant compression by using (8+1)-bit representation for 4 32-bit floats
!     compression rate factor: ~3.98x (123474736 Bytes / 30998320 Bytes ~ 118 GB / 30GB)
!                              betav_kl_crust_mantle total norm of difference :   2.6486799E-22
! - {'rate','12'} has better accuracy (leading to small wavefield perturbations)
!     compression rate factor: ~2.65x (123474736 Bytes / 46423124 Bytes ~ 118 GB / 45GB)
!                              betav_kl_crust_mantle total norm of difference :   4.3890730E-24
! - {'precision','10'} leads to a more variable compression for wavefields depending on their dynamic range
!     compression rate factor: ~4.05x (123474736 Bytes / 30460388 Bytes ~ 118 GB / 30 GB)
!                              betav_kl_crust_mantle total norm of difference :   5.3706092E-24
! - {'precision','12'} has better accuracy (leading to small wavefield perturbations)
!     compression rate factor: ~3.43x (123474736 Bytes / 35972672 Bytes ~ 118 GB / 35GB)
!                              betav_kl_crust_mantle total norm of difference :   1.9846376E-25
! - {'precision','20'} has good accuracy (almost identical reconstructed waveforms)
!     compression rate factor: ~2.12x (123474736 Bytes / 58020080 Bytes ~ 118 GB / 56 GB)
!                              betav_kl_crust_mantle total norm of difference :   2.5939579E-30
!
! performance overhead for compressing/decompressing is negligible in all cases
! (a few seconds, compared to minutes for the total simulaton)
!
! a default setting of {'precision','12'} seems a good compromise between accuracy and compression rate
  character(len=*), parameter :: ADIOS_COMPRESSION_MODE = 'precision'     ! 'precision','rate'
  character(len=*), parameter :: ADIOS_COMPRESSION_MODE_VALUE = '12'      ! '8','12,'20'

!! SZ compression
! parameters: 'accuracy', value '0.0000000001' = 1.e-10
!             leaving empty '','' chooses automatic setting? to check...
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE = ''
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE_VALUE = ''

!! LZ4 compression (lossless)
! parameters: level 'lvl=9' and 'threshold=4096' 4K-bytes
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE = 'lvl'
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE_VALUE = '9,threshold=4096'

! size of the ADIOS buffer to use
  integer, parameter :: ADIOS_BUFFER_SIZE_IN_MB = 400

! ADIOS transport methods (see ADIOS manual for details)
!! MPI (default)
  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD = "MPI"
  character(len=*), parameter :: ADIOS_METHOD_PARAMS =  ''

! ADIOS transport methods for undo save_frame** data files
!! MPI (default)
  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "MPI"
  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  ''
! or
!! POSIX
!  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "POSIX"
!  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  ''
! or
!! MPI_AGGREGATE
!  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "MPI_AGGREGATE"
!  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  "num_aggregators=64,num_ost=672"
! or
!! MPI_LUSTRE
!  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "MPI_LUSTRE"
!  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  "stripe_count=16,stripe_size=4194304,block_size=4194304"

!!-----------------------------------------------------------
!!
!! ADIOS2 Related values
!!
!!-----------------------------------------------------------

! ADIOS2 engines
!! note on native engine types:
!!  - "MPI" is not supported yet by adios2 version (current 2.6.0), check out in future.
!!  - "HDF5" doesn't support file appending yet, which is needed at the moment.
!!  - "BPfile" doesn't support file appending yet, which is needed at the moment.
!!  - "BP3" would allow for backward compatibility to ADIOS 1.x, but doesn't support file appending yet.
!!  - "BP4" is the new adios2 format with enhanced capabilities.
!! we will use "BP4" by default.
!!
!! BP4
!! format details: https://adios2.readthedocs.io/en/latest/engines/engines.html#bp4
!!
!! note: parameter SubStreams=64 for larger runs with NPROCS > 64 creates problems when reading scalar values (in appended mode),
!!       try to avoid it for now as default parameter.
!!       for undo_att, it seems to work however and can be used in ADIOS2_ENGINE_PARAMS_UNDO_ATT setting.
!!
!!       in future adios2 versions, re-evalute if parameters could be "SubStreams=64,MaxBufferSize=800Mb" for larger runs
  character(len=*), parameter :: ADIOS2_ENGINE_DEFAULT = "BP4"
  character(len=*), parameter :: ADIOS2_ENGINE_PARAMS_DEFAULT = "" ! add "MaxBufferSize=800Mb" for larger runs

  character(len=*), parameter :: ADIOS2_ENGINE_UNDO_ATT = "BP4"
  character(len=*), parameter :: ADIOS2_ENGINE_PARAMS_UNDO_ATT = "" ! add "SubStreams=64,MaxBufferSize=800Mb" for larger runs


!!-----------------------------------------------------------
!!
!! ASDF parameters
!!
!!-----------------------------------------------------------

! keeps track of everything
! stores specfem provenance string in ASDF file
  logical, parameter :: ASDF_OUTPUT_PROVENANCE = .false.

! ASDF string lengths
  integer, parameter :: ASDF_MAX_STRING_LENGTH = 1024
  integer, parameter :: ASDF_MAX_QUAKEML_LENGTH = 8096
  integer, parameter :: ASDF_MAX_STATIONXML_LENGTH = 16182
  integer, parameter :: ASDF_MAX_PARFILE_LENGTH = 25000
  integer, parameter :: ASDF_MAX_CONSTANTS_LENGTH = 65000
  integer, parameter :: ASDF_MAX_TIME_STRING_LENGTH = 22


!!-----------------------------------------------------------
!!
!! adjoint kernel outputs
!!
!!-----------------------------------------------------------

! asynchronuous reading of adjoint sources
  logical, parameter :: IO_ASYNC_COPY = .true.

! regular kernel parameters
  character(len=*), parameter :: PATHNAME_KL_REG = 'DATA/kl_reg_grid.txt'
  integer, parameter :: NM_KL_REG_LAYER = 100
  integer, parameter :: NM_KL_REG_PTS = 300000
  real, parameter :: KL_REG_MIN_LON = 0.0
  real, parameter :: KL_REG_MAX_LON = 360.0
  real, parameter :: KL_REG_MIN_LAT = -90.0
  real, parameter :: KL_REG_MAX_LAT = +90.0

! by default, we turn kernel computations in the outer and inner core and for topology kernels off
!
! kernels for outer core
  logical, parameter :: SAVE_KERNELS_OC = .false.

! kernels for inner core
  logical, parameter :: SAVE_KERNELS_IC = .false.

! kernels for MOHO, 400, 670, CMB and ICB discontinuities
  logical, parameter :: SAVE_KERNELS_BOUNDARY = .false.

! Boundary Mesh -- save Moho, 400, 670 km discontinuity topology files (in
! the mesher) and use them for the computation of boundary kernel (in the solver)
  logical, parameter :: SAVE_BOUNDARY_MESH = SAVE_KERNELS_BOUNDARY

! flag to write seismograms with adjoint wavefield instead of backward, reconstructed wavefield
  logical, parameter :: OUTPUT_ADJOINT_WAVEFIELD_SEISMOGRAMS = .false.

! flag to use source-receicer preconditioner instead of source-source preconditioner
  logical, parameter :: USE_SOURCE_RECEIVER_Hessian = .true.

! number of timesteps between calling compute_kernels() in adjoint simulation with undo_attenuation
! note: this flag is tested for stationary kernels only (STEADY_STATE_KERNEL = .true.)
! be careful when changing this flag when computing classical kernel
  integer, parameter :: NTSTEP_BETWEEN_COMPUTE_KERNELS = 1


!!-----------------------------------------------------------
!!
!! time stamp information
!!
!!-----------------------------------------------------------

! print date and time estimate of end of run in another country,
! in addition to local time.
! For instance: the code runs at Caltech in California but the person
! running the code is connected remotely from France, which has 9 hours more.
! The time difference with that remote location can be positive or negative
  logical, parameter :: ADD_TIME_ESTIMATE_ELSEWHERE = .false.
  integer, parameter :: HOURS_TIME_DIFFERENCE = +9
  integer, parameter :: MINUTES_TIME_DIFFERENCE = +0


!!-----------------------------------------------------------
!!
!! directory structure
!!
!!-----------------------------------------------------------

! paths for inputs and outputs files
  character(len=*), parameter :: OUTPUT_FILES_BASE = './OUTPUT_FILES/'


!!-----------------------------------------------------------
!!
!! movie outputs
!!
!!-----------------------------------------------------------

! runs external bash script after storing movie files
! (useful for postprocessing during simulation time)
  logical, parameter :: RUN_EXTERNAL_MOVIE_SCRIPT = .false.
  character(len=*),parameter :: MOVIE_SCRIPT_NAME = "./tar_movie_files.sh"

!!-----------------------------------------------------------
!!
!! smoothing of the sensitivity kernels
!!
!!-----------------------------------------------------------

! using this is more precise, but more costly
  logical, parameter :: USE_QUADRATURE_RULE_FOR_SMOOTHING = .true.

! using Euclidian vector distance to calculate vertical and horizontal distances between two points,
! which is faster than using the exact epicentral distance for the horizontal distance.
  logical, parameter :: USE_VECTOR_DISTANCE_FOR_SMOOTHING = .true.


!!-----------------------------------------------------------
!!
!! for gravity integrals
!!
!!-----------------------------------------------------------
! (for using gravity integral computations, please make sure you compile with double-precision --enable-double-precision)

  logical, parameter :: GRAVITY_INTEGRALS = .false.

! reuse an existing observation surface created in another run and stored to disk,
! so that we are sure that they are exactly the same (for instance when comparing results for a reference ellipsoidal Earth
! and results for a 3D Earth with topography)
  logical, parameter :: REUSE_EXISTING_OBSERVATION_SURF = .false.

! only compute the center of mass of the 3D model (very cheap), or also compute the gravity integrals (expensive)
  logical, parameter :: ONLY_COMPUTE_CENTER_OF_MASS = .false.

! we may want to shift the reference frame to a pre-computed center of mass
  logical, parameter :: SHIFT_TO_THIS_CENTER_OF_MASS = .true.

! position of the center of mass of the Earth for this density model and mesh,
! but first convert it to meters and then make it non-dimensional
  double precision, parameter :: x_shift =   0.606220633681674d0 * 1000.d0 / EARTH_R !    km
  double precision, parameter :: y_shift =   0.433103991863316d0 * 1000.d0 / EARTH_R !    km
  double precision, parameter :: z_shift =   0.520078637496872d0 * 1000.d0 / EARTH_R !    km
!    distance to center =   0.908605697566306       km

! altitude of the observation points in km
  double precision, parameter :: altitude_of_observation_points = 255.d0

! elevation ratio of the points at which we observe
  double precision, parameter :: observation_elevation_ratio = (EARTH_R_KM + altitude_of_observation_points) / EARTH_R_KM

! compute the contribution of the crust only (otherwise by default compute the contribution of the whole Earth)
  logical, parameter :: COMPUTE_CRUST_CONTRIB_ONLY = .false.

! check for negative Jacobians in the calculation of integrals or not
! (can safely be done once to check that the mesh is OK at a given resolution, and then permanently
!  turned off in future runs because the mesh does not change)
  logical, parameter :: CHECK_FOR_NEGATIVE_JACOBIANS = .true.

! number of points in each horizontal direction of the observation grid of each cubed-sphere chunk
! at the altitude of the observation point
!! 4 is a fictitious value used to save memory when the GRAVITY_INTEGRALS option is off
  integer, parameter :: NX_OBSERVATION = 4 ! 500
  integer, parameter :: NY_OBSERVATION = NX_OBSERVATION

! the code will display sample output values at this particular point as a check
  integer, parameter :: ixr = max(int(NX_OBSERVATION / 3.0), 1)
  integer, parameter :: iyr = max(int(NY_OBSERVATION / 4.0), 1)
  integer, parameter :: ichunkr = 3

! how often (every how many spectral elements computed) we print a timestamp to monitor the behavior of the code
  integer, parameter :: NSPEC_DISPLAY_INTERVAL = 100


!!-----------------------------------------------------------
!!
!! debugging flags
!!
!!-----------------------------------------------------------

! flag to turn on ordered assembly, where the the order of the summation depends on the order of MPI ranks.
! used for testing
  logical, parameter :: DO_ORDERED_ASSEMBLY = .false.

! flags to actually assemble with MPI or not
! and to actually match fluid and solid regions of the Earth or not
! should always be set to true except when debugging code
  logical, parameter :: ACTUALLY_ASSEMBLE_MPI_SLICES = .true.
  logical, parameter :: ACTUALLY_ASSEMBLE_MPI_CHUNKS = .true.
  logical, parameter :: ACTUALLY_COUPLE_FLUID_CMB = .true.
  logical, parameter :: ACTUALLY_COUPLE_FLUID_ICB = .true.

! flag to turn off the conversion of geographic to geocentric coordinates for
! the seismic source and the stations; i.e. assume a perfect sphere, which
! can be useful for benchmarks of a spherical Earth with fictitious sources and stations
  logical, parameter :: ASSUME_PERFECT_SPHERE = .false.

! flags to do benchmark runs to measure scaling of the code
! for a limited number of time steps only, setting the initial field to 1
! to make sure gradual underflow trapping does not slow down the code
  logical, parameter :: DO_BENCHMARK_RUN_ONLY = .false.
  integer, parameter :: NSTEP_FOR_BENCHMARK = 300
  logical, parameter :: SET_INITIAL_FIELD_TO_1_IN_BENCH = .true.

! for validation of undoing of attenuation versus an exact solution saved to disk
! should never be needed any more, it was developed and used for Figure 3 of
! D. Komatitsch, Z. Xie, E. Bozdag, E. Sales de Andrade, D. Peter, Q. Liu and J. Tromp,
! Anelastic sensitivity kernels with parsimonious storage for adjoint tomography and full waveform inversion,
! Geophysical Journal International, vol. 206(3), p. 1467-1478, doi: 10.1093/gji/ggw224 (2016).
!
! Compute an alpha sensitivity kernel directly by dumping the whole forward
! run to disk instead of rebuilding it backwards from the final time step in a second stage;
! used for debugging and validation purposes only, in order to have an exact reference for the sensitivity kernels.
! use wisely, this requires several terabytes (yes, tera) of disk space.
! In the future that option should become standard at some point though.
! For now, in order to save disk space, it is implemented for the alpha kernel only
! (because it only requires saving a scalar: the trace of epsilon) and for surface wave
! kernels only, this way we can save the upper mantle only and ignore the rest.
! In the future it will be easy to generalize this though.
  logical, parameter :: EXACT_UNDOING_TO_DISK = .false.
  ! ID of the huge file in which we dump all the time steps of the simulation
  integer, parameter :: IFILE_FOR_EXACT_UNDOING = 244
  ! Number of time steps between dumping the forward run
  integer, parameter :: NSTEP_FOR_EXACT_UNDOING = 500

!------------------------------------------------------
!----------- do not modify anything below -------------
!------------------------------------------------------

! on some processors (e.g. some Intel chips) it is necessary to suppress underflows
! by using a small initial field instead of zero
!! August 2018: on modern processors this does not happen any more,
!! August 2018: and thus no need to purposely lose accuracy to avoid underflows; thus turning it off by default
  logical, parameter :: FIX_UNDERFLOW_PROBLEM = .false. ! .true.

! some useful constants
  double precision, parameter :: PI = 3.141592653589793d0
  double precision, parameter :: TWO_PI = 2.d0 * PI
  double precision, parameter :: PI_OVER_FOUR = PI / 4.d0
  double precision, parameter :: PI_OVER_TWO = PI / 2.0d0

! to convert angles from degrees to radians
  double precision, parameter :: DEGREES_TO_RADIANS = PI / 180.d0
! to convert angles from radians to degrees
  double precision, parameter :: RADIANS_TO_DEGREES = 180.d0 / PI

! 3-D simulation
  integer, parameter :: NDIM = 3

! dimension of the boundaries of the slices
  integer, parameter :: NDIM2D = 2

! number of nodes for 2D and 3D shape functions for hexahedra with 27 nodes
  integer, parameter :: NGNOD = 27, NGNOD2D = 9

! assumes NGLLX == NGLLY == NGLLZ
  integer, parameter :: NGLLSQUARE = NGLLX * NGLLY

! Deville routines optimized for NGLLX = NGLLY = NGLLZ = 5
  integer, parameter :: m1 = NGLLX, m2 = NGLLX * NGLLY
  integer, parameter :: NGLLCUBE = NGLLX * NGLLY * NGLLZ

! mid-points inside a GLL element
  integer, parameter :: MIDX = (NGLLX+1)/2
  integer, parameter :: MIDY = (NGLLY+1)/2
  integer, parameter :: MIDZ = (NGLLZ+1)/2

! gravitational constant in S.I. units i.e. in m3 kg-1 s-2, or equivalently in N.(m/kg)^2
!! April 2014: switched to the 2010 Committee on Data for Science and Technology (CODATA) recommended value
!! see e.g. http://www.physics.nist.gov/cgi-bin/cuu/Value?bg
!! and http://en.wikipedia.org/wiki/Gravitational_constant
!! double precision, parameter :: GRAV = 6.6723d-11
!! double precision, parameter :: GRAV = 6.67430d-11  ! newer suggestion by CODATA 2018
  double precision, parameter :: GRAV = 6.67384d-11  ! CODATA 2010

! standard gravity at the surface of the Earth
  double precision, parameter :: EARTH_STANDARD_GRAVITY = 9.80665d0 ! in m.s-2

! a few useful constants
  double precision, parameter :: ZERO = 0.d0,ONE = 1.d0,TWO = 2.d0,HALF = 0.5d0
  double precision, parameter :: ONE_HALF = HALF, ONE_FOURTH = 0.25d0, ONE_EIGHTH = 0.125d0, ONE_SIXTEENTH = 0.0625d0

  real(kind=CUSTOM_REAL), parameter :: &
    ONE_THIRD   = 1._CUSTOM_REAL/3._CUSTOM_REAL, &
    TWO_THIRDS  = 2._CUSTOM_REAL/3._CUSTOM_REAL, &
    FOUR_THIRDS = 4._CUSTOM_REAL/3._CUSTOM_REAL

! very large and very small values
  double precision, parameter :: HUGEVAL = 1.d+30,TINYVAL = 1.d-9

! very large real value declared independently of the machine
  real(kind=CUSTOM_REAL), parameter :: HUGEVAL_SNGL = 1.e+30_CUSTOM_REAL

! very large integer value
  integer, parameter :: HUGEINT = 100000000

! normalized radius of free surface
  double precision, parameter :: R_UNIT_SPHERE = ONE

! fixed thickness of 3 km for PREM oceans
  double precision, parameter :: THICKNESS_OCEANS_PREM = 3000.d0 / EARTH_R

! shortest radius at which crust is implemented (80 km depth)
! to be constistent with the D80 discontinuity, we impose the crust only above it
  double precision, parameter :: EARTH_R_DEEPEST_CRUST = (EARTH_R - 80000.d0) / EARTH_R

! definition of an Eotvos compared to S.I. units.
! The unit of gravity gradient is the Eotvos, which is equivalent to 1e-9 s-2 (or 1e-4 mGal/m).
! A person walking at a distance of 2 meters provides a gravity gradient signal of approximately one Eotvos.
! Mountains can create signals of several hundred Eotvos.
  double precision, parameter :: SI_UNITS_TO_EOTVOS = 1.d+9

! define block type based upon chunk number (between 1 and 6)
! do not change this numbering, chunk AB must be number 1 for central cube
  integer, parameter :: CHUNK_AB = 1
  integer, parameter :: CHUNK_AC = 2
  integer, parameter :: CHUNK_BC = 3
  integer, parameter :: CHUNK_AC_ANTIPODE = 4
  integer, parameter :: CHUNK_BC_ANTIPODE = 5
  integer, parameter :: CHUNK_AB_ANTIPODE = 6

! maximum number of regions in the mesh
  integer, parameter :: MAX_NUM_REGIONS = 5    ! (CRUST_MANTLE, OUTER_CORE, INNER_CORE) + (TRINFINITE, INFINITE) regions

! define flag for planet
! strictly speaking, the moon is not a planet but a natural satellite. well, let's stay with IPLANET_** for now.
  integer, parameter :: IPLANET_EARTH = 1
  integer, parameter :: IPLANET_MARS = 2
  integer, parameter :: IPLANET_MOON = 3

! define flag for regions of the global Earth mesh
  integer, parameter :: IREGION_CRUST_MANTLE = 1
  integer, parameter :: IREGION_OUTER_CORE = 2
  integer, parameter :: IREGION_INNER_CORE = 3

! define flag for region of the infinite-element mesh surrounding the global mesh
  integer, parameter :: IREGION_TRINFINITE = 4      ! transition-to-infinite region
  integer, parameter :: IREGION_INFINITE = 5        ! infinite mesh region

! define flag for elements
  integer, parameter :: IFLAG_CRUST = 1

  integer, parameter :: IFLAG_80_MOHO = 2
  integer, parameter :: IFLAG_220_80 = 3
  integer, parameter :: IFLAG_670_220 = 4
  integer, parameter :: IFLAG_MANTLE_NORMAL = 5

  integer, parameter :: IFLAG_OUTER_CORE_NORMAL = 6

  integer, parameter :: IFLAG_INNER_CORE_NORMAL = 7
  integer, parameter :: IFLAG_MIDDLE_CENTRAL_CUBE = 8
  integer, parameter :: IFLAG_BOTTOM_CENTRAL_CUBE = 9
  integer, parameter :: IFLAG_TOP_CENTRAL_CUBE = 10
  integer, parameter :: IFLAG_IN_FICTITIOUS_CUBE = 11

  integer, parameter :: NSPEC2D_XI_SUPERBRICK = 8
  integer, parameter :: NSPEC2D_ETA_SUPERBRICK = 8
  integer, parameter :: NSPEC2D_XI_SUPERBRICK_1L = 6
  integer, parameter :: NSPEC2D_ETA_SUPERBRICK_1L = 6

! dummy flag used for mesh display purposes only
  integer, parameter :: IFLAG_DUMMY = 100

! max number of layers that are used in the radial direction to build the full mesh
  integer, parameter :: MAX_NUMBER_OF_MESH_LAYERS = 15

! define number of spectral elements and points in basic symmetric mesh doubling superbrick
  integer, parameter :: NSPEC_DOUBLING_SUPERBRICK = 32
  integer, parameter :: NGLOB_DOUBLING_SUPERBRICK = 67
  integer, parameter :: NSPEC_SUPERBRICK_1L = 28
  integer, parameter :: NGLOB_SUPERBRICK_1L = 58
  integer, parameter :: NGNOD_EIGHT_CORNERS = 8

! define flag for reference 1D Earth model
  integer, parameter :: REFERENCE_MODEL_PREM       = 1
  integer, parameter :: REFERENCE_MODEL_PREM2      = 2
  integer, parameter :: REFERENCE_MODEL_IASP91     = 3
  integer, parameter :: REFERENCE_MODEL_1066A      = 4
  integer, parameter :: REFERENCE_MODEL_AK135F_NO_MUD = 5
  integer, parameter :: REFERENCE_MODEL_1DREF      = 6
  integer, parameter :: REFERENCE_MODEL_JP1D       = 7
  integer, parameter :: REFERENCE_MODEL_SEA1D      = 8
  integer, parameter :: REFERENCE_MODEL_CCREM      = 9
  integer, parameter :: REFERENCE_MODEL_SEMUCB     = 10   ! Berkeley reference model
  ! Mars
  integer, parameter :: REFERENCE_MODEL_SOHL       = 101
  integer, parameter :: REFERENCE_MODEL_SOHL_B     = 102
  integer, parameter :: REFERENCE_MODEL_CASE65TAY  = 103
  integer, parameter :: REFERENCE_MODEL_MARS_1D    = 104  ! defined by file

  ! Moon
  integer, parameter :: REFERENCE_MODEL_VPREMOON   = 201
  integer, parameter :: REFERENCE_MODEL_MOON_MEENA = 202

! crustal model constants
  integer, parameter :: ICRUST_CRUST1      = 1    ! Crust1.0
  integer, parameter :: ICRUST_CRUST2      = 2    ! Crust2.0
  integer, parameter :: ICRUST_CRUSTMAPS   = 3    ! Crustmaps
  integer, parameter :: ICRUST_EPCRUST     = 4    ! EPcrust
  integer, parameter :: ICRUST_CRUST_SH    = 5    ! Spherical-Harmonics Crust
  integer, parameter :: ICRUST_EUCRUST     = 6    ! EUcrust07
  integer, parameter :: ICRUST_SGLOBECRUST = 7    ! modified Crust2.0 for SGLOBE-rani
  integer, parameter :: ICRUST_BKMNS_GLAD  = 8    ! Block Mantle Spherical-Harmonics model
  integer, parameter :: ICRUST_SPIRAL      = 9    ! SPiRaL
  integer, parameter :: ICRUST_SH_MARS     = 10   ! SH mars models (define crust & mantle values)
  integer, parameter :: ICRUST_BERKELEY    = 11   ! Berkeley crustal model

! define flag for 3D Earth model
  integer, parameter :: THREE_D_MODEL_S20RTS        = 101
  integer, parameter :: THREE_D_MODEL_S362ANI       = 102
  integer, parameter :: THREE_D_MODEL_S362WMANI     = 103
  integer, parameter :: THREE_D_MODEL_S362ANI_PREM  = 104
  integer, parameter :: THREE_D_MODEL_S29EA         = 105
  integer, parameter :: THREE_D_MODEL_SEA99_JP3D    = 106
  integer, parameter :: THREE_D_MODEL_SEA99         = 107
  integer, parameter :: THREE_D_MODEL_JP3D          = 108
  integer, parameter :: THREE_D_MODEL_PPM           = 109            ! format for point profile models
  integer, parameter :: THREE_D_MODEL_GLL           = 110            ! format for iterations with GLL mesh
  integer, parameter :: THREE_D_MODEL_S40RTS        = 111
  integer, parameter :: THREE_D_MODEL_GAPP2         = 112
  integer, parameter :: THREE_D_MODEL_MANTLE_SH     = 113
  integer, parameter :: THREE_D_MODEL_SGLOBE        = 114
  integer, parameter :: THREE_D_MODEL_SGLOBE_ISO    = 115
  integer, parameter :: THREE_D_MODEL_ANISO_MANTLE  = 116
  integer, parameter :: THREE_D_MODEL_BKMNS_GLAD    = 117
  integer, parameter :: THREE_D_MODEL_SPIRAL        = 118
  integer, parameter :: THREE_D_MODEL_HETEROGEN_PREM = 119
  integer, parameter :: THREE_D_MODEL_SH_MARS       = 120
  integer, parameter :: THREE_D_MODEL_BERKELEY      = 121
  ! inner core model
  integer, parameter :: THREE_D_MODEL_INNER_CORE_ISHII = 201

!! attenuation
! number of standard linear solids for attenuation
  integer, parameter :: N_SLS = 3

! computation of standard linear solids in meshfem3D
! ATTENUATION_COMP_RESOLUTION: Number of Digits after decimal
! ATTENUATION_COMP_MAXIMUM:    Maximum Q Value
  integer, parameter :: ATTENUATION_COMP_RESOLUTION = 1
  integer, parameter :: ATTENUATION_COMP_MAXIMUM    = 9000

! for determination of the attenuation period range
! if this is set to .true. then the hardcoded values will be used
! otherwise they are computed automatically from the Number of elements
! This *may* be a useful parameter for Benchmarking against older versions
  logical, parameter :: ATTENUATION_RANGE_PREDEFINED = .false.

! flag for the four edges of each slice and for the bottom edge
  integer, parameter :: XI_MIN  = 1
  integer, parameter :: XI_MAX  = 2
  integer, parameter :: ETA_MIN = 3
  integer, parameter :: ETA_MAX = 4
  integer, parameter :: BOTTOM  = 5

! flags to select the right corner in each slice
  integer, parameter :: ILOWERLOWER = 1
  integer, parameter :: ILOWERUPPER = 2
  integer, parameter :: IUPPERLOWER = 3
  integer, parameter :: IUPPERUPPER = 4

! number of points in each AVS or OpenDX quadrangular cell for movies
  integer, parameter :: NGNOD2D_AVS_DX = 4

! number of faces a given slice can share with other slices
! this is at most 2, except when there is only once slice per chunk
! in which case it is 4
  integer, parameter :: NUMFACES_SHARED = 4

! number of corners a given slice can share with other slices
! this is at most 1, except when there is only once slice per chunk
! in which case it is 4
  integer, parameter :: NUMCORNERS_SHARED = 4

! number of layers in PREM
  integer, parameter :: NR_DENSITY = 640

! smallest real number on many machines =  1.1754944E-38
! largest real number on many machines =  3.4028235E+38
! small negligible initial value to avoid very slow underflow trapping
! but not too small to avoid trapping on velocity and acceleration in Newmark
  real(kind=CUSTOM_REAL), parameter :: VERYSMALLVAL = 1.E-24_CUSTOM_REAL

! displacement threshold above which we consider that the code became unstable
  real(kind=CUSTOM_REAL), parameter :: STABILITY_THRESHOLD = 1.E+25_CUSTOM_REAL

! geometrical tolerance for boundary detection
  double precision, parameter :: SMALLVAL = 0.00001d0

! small tolerance for conversion from x y z to r theta phi
  double precision, parameter :: SMALL_VAL_ANGLE = 1.d-10

! geometry tolerance parameter to calculate number of independent grid points
! sensitive to actual size of model, assumes reference sphere of radius 1
! this is an absolute value for normalized coordinates in the Earth
  double precision, parameter :: SMALLVALTOL = 1.d-10

! do not use tags for MPI messages, use dummy tag instead
  integer, parameter :: itag = 0,itag2 = 0

! for the Gauss-Lobatto-Legendre points and weights
  double precision, parameter :: GAUSSALPHA = 0.d0,GAUSSBETA = 0.d0

! number of lines per source in CMTSOLUTION file
  integer, parameter :: NLINES_PER_CMTSOLUTION_SOURCE = 13
  integer, parameter :: NLINES_PER_FORCESOLUTION_SOURCE = 11

! number of iterations to solve the system for xi and eta
! setting it to 5 instead of 4 ensures that the result obtained is not compiler dependent
! (when using 4 only some small discrepancies were observed)
  integer, parameter :: NUM_ITER = 5

! number of hours per day for rotation rate of the Earth
  double precision, parameter :: EARTH_HOURS_PER_DAY = 24.d0
  double precision, parameter :: EARTH_SECONDS_PER_HOUR = 3600.d0

! for lookup table for gravity every 100 m in radial direction of Earth model
  integer, parameter :: NRAD_GRAVITY = 70000


!!-----------------------------------------------------------
!!
!! GLL model constants
!!
!!-----------------------------------------------------------

! parameters for GLL model (used for iterative model inversions)
  character(len=*), parameter :: PATHNAME_GLL_modeldir = 'DATA/GLL/'

! to create a reference model based on the 1D reference model but with 3D crust and 410/660 topography
  logical,parameter :: USE_1D_REFERENCE = .false.

!!-- uncomment for using PREM as reference model (used in CEM inversion)
!  integer, parameter :: GLL_REFERENCE_1D_MODEL = REFERENCE_MODEL_PREM
!  integer, parameter :: GLL_REFERENCE_MODEL = REFERENCE_MODEL_PREM

!!-- uncomment for using S362ANI as reference model
  integer, parameter :: GLL_REFERENCE_1D_MODEL = REFERENCE_MODEL_1DREF
  integer, parameter :: GLL_REFERENCE_MODEL = THREE_D_MODEL_S362ANI

!!-- uncomment for using S29EA as reference model
!  integer, parameter :: GLL_REFERENCE_1D_MODEL = REFERENCE_MODEL_1DREF
!  integer, parameter :: GLL_REFERENCE_MODEL = THREE_D_MODEL_S29EA

!!-----------------------------------------------------------
!!
!! crustal stretching
!!
!!-----------------------------------------------------------

! for the stretching of crustal elements in the case of 3D models
! (values are chosen for 3D models to have RMOHO_FICTITIOUS at 35 km
!  and RMIDDLE_CRUST to become 15 km with stretching function stretch_tab)
  double precision, parameter :: EARTH_MAX_RATIO_CRUST_STRETCHING = 0.75d0
  double precision, parameter :: EARTH_RMOHO_STRETCH_ADJUSTMENT = 5000.d0 ! moho up to 35km
  double precision, parameter :: EARTH_R80_STRETCH_ADJUSTMENT = -40000.d0 ! r80 down to 120km

! adapted regional moho stretching
! 1 chunk simulations, 3-layer crust
  logical, parameter :: EARTH_REGIONAL_MOHO_MESH = .false.
  logical, parameter :: EARTH_REGIONAL_MOHO_MESH_EUROPE = .false. ! used only for fixing time step
  logical, parameter :: EARTH_REGIONAL_MOHO_MESH_ASIA = .false.   ! used only for fixing time step
  logical, parameter :: EARTH_HONOR_DEEP_MOHO = .false.
!!-- uncomment for e.g. Europe case, where deep moho is rare
!  double precision, parameter :: EARTH_RMOHO_STRETCH_ADJUSTMENT = -15000.d0  ! moho mesh boundary down to 55km
!!-- uncomment for deep moho cases, e.g. Asia case (Himalayan moho)
!  double precision, parameter :: EARTH_RMOHO_STRETCH_ADJUSTMENT = -20000.d0  ! moho mesh boundary down to 60km

!!-----------------------------------------------------------
!!
!! mesh tweaking
!!
!!-----------------------------------------------------------

! to suppress the crustal layers
! (replaced by an extension of the mantle: EARTH_R is not modified, but no more crustal doubling)
  logical, parameter :: SUPPRESS_CRUSTAL_MESH = .false.

! to inflate the central cube (set to 0.d0 for a non-inflated cube)
  double precision, parameter :: CENTRAL_CUBE_INFLATE_FACTOR = 0.41d0

! to add a fourth doubling at the bottom of the outer core
  logical, parameter :: ADD_4TH_DOUBLING = .false.

! parameters to cut the doubling brick

! this to cut the superbrick: 3 possibilities, 4 cases max / possibility
! three possibilities: (cut in xi and eta) or (cut in xi) or (cut in eta)
! case 1: (ximin and etamin) or ximin or etamin
! case 2: (ximin and etamax) or ximax or etamax
! case 3: ximax and etamin
! case 4: ximax and etamax
  integer, parameter :: NB_CUT_CASE = 4

! corner 1: ximin and etamin
! corner 2: ximax and etamin
! corner 3: ximax and etamax
! corner 4: ximin and etamax
  integer, parameter :: NB_SQUARE_CORNERS = 4

! two possibilities: xi or eta
! face 1: ximin or etamin
! face 2: ximax or etamax
  integer, parameter :: NB_SQUARE_EDGES_ONEDIR = 2

! this for the geometry of the basic doubling brick
  integer, parameter :: NSPEC_DOUBLING_BASICBRICK = 8
  integer, parameter :: NGLOB_DOUBLING_BASICBRICK = 27

!!-----------------------------------------------------------
!!
!! for LDDRK high-order time scheme
!!
!!-----------------------------------------------------------

! Low-dissipation and low-dispersion fourth-order Runge-Kutta algorithm
!
! reference:
! J. Berland, C. Bogey, and C. Bailly.
! Low-dissipation and low-dispersion fourth-order Runge-Kutta algorithm.
! Computers and Fluids, 35:1459-1463, 2006
!
! see: http://www.sciencedirect.com/science/article/pii/S0045793005000575?np=y

! number of stages
  integer, parameter :: NSTAGE = 6

! coefficients from Table 1, Berland et al. (2006)
  real(kind=CUSTOM_REAL), dimension(NSTAGE), parameter :: ALPHA_LDDRK = &
    (/0.0_CUSTOM_REAL,-0.737101392796_CUSTOM_REAL, -1.634740794341_CUSTOM_REAL, &
      -0.744739003780_CUSTOM_REAL,-1.469897351522_CUSTOM_REAL,-2.813971388035_CUSTOM_REAL/)

  real(kind=CUSTOM_REAL), dimension(NSTAGE), parameter :: BETA_LDDRK = &
    (/0.032918605146_CUSTOM_REAL,0.823256998200_CUSTOM_REAL,0.381530948900_CUSTOM_REAL, &
      0.200092213184_CUSTOM_REAL,1.718581042715_CUSTOM_REAL,0.27_CUSTOM_REAL/)

  real(kind=CUSTOM_REAL), dimension(NSTAGE), parameter :: C_LDDRK = &
    (/0.0_CUSTOM_REAL,0.032918605146_CUSTOM_REAL,0.249351723343_CUSTOM_REAL, &
      0.466911705055_CUSTOM_REAL,0.582030414044_CUSTOM_REAL,0.847252983783_CUSTOM_REAL/)


!!-----------------------------------------------------------
!!
!! Mars
!!
!!-----------------------------------------------------------
! Model MARS
  double precision, parameter :: MARS_R = 3390000.d0    ! default 3390.0 km radius based on Sohl models
  double precision, parameter :: R_MARS = MARS_R

! radius of the MARS in km
  double precision, parameter :: MARS_R_KM = MARS_R / 1000.d0
  double precision, parameter :: R_MARS_KM = MARS_R_KM

! average density in the full MARS to normalize equation
  double precision, parameter :: MARS_RHOAV = 3393.0d0

! Topography
!--- 4-minute model
! size of topography and bathymetry file
  integer, parameter :: MARS_NX_BATHY_4 = 5400,MARS_NY_BATHY_4 = 2700
! resolution of topography file in minutes
  double precision, parameter :: MARS_RESOLUTION_TOPO_FILE_4 = 4.0
! pathname of the topography file
  character (len=*), parameter :: MARS_PATHNAME_TOPO_FILE_4 = 'DATA/topo_bathy/topo_bathy_marstopo4_smoothed_window_3.dat.bin'
!--- Default
! Topography defaults to 4-minute
  integer, parameter :: MARS_NX_BATHY = MARS_NX_BATHY_4
  integer, parameter :: MARS_NY_BATHY = MARS_NY_BATHY_4
  double precision, parameter :: MARS_RESOLUTION_TOPO_FILE = MARS_RESOLUTION_TOPO_FILE_4
  character (len=*), parameter :: MARS_PATHNAME_TOPO_FILE = MARS_PATHNAME_TOPO_FILE_4

! Topography value min/max range
  integer, parameter :: MARS_TOPO_MINIMUM = - 8000 ! (max depth in m, Mars)
  integer, parameter :: MARS_TOPO_MAXIMUM = + 23200 ! (height in m, Olympus Mons)

! For the reference ellipsoid to convert geographic latitudes to geocentric:
! Mars flattening (https://en.wikipedia.org/wiki/Mars): 0.00589 +/- 0.00015 -> 1/f with f ~ 169.77
! Smith et al. 1999, The global topography of Mars and implications for surface evolution. Science 284(5419), 1495-1503
! uses f = 169.8
  double precision, parameter :: MARS_FLATTENING_F = 1.d0 / 169.8d0
  double precision, parameter :: MARS_ONE_MINUS_F_SQUARED = (1.d0 - MARS_FLATTENING_F)**2

! doubling layers
  double precision, parameter :: MARS_DEPTH_SECOND_DOUBLING_OPTIMAL = 1200000.d0
  double precision, parameter :: MARS_DEPTH_THIRD_DOUBLING_OPTIMAL  = 2090000.d0
  double precision, parameter :: MARS_DEPTH_FOURTH_DOUBLING_OPTIMAL = 2690000.d0

! standard gravity at the surface
  double precision, parameter :: MARS_STANDARD_GRAVITY = 3.71d0 ! in m.s-2

! shortest radius at which crust is implemented (150 km depth)
! we impose the crust only above it
  double precision, parameter :: MARS_R_DEEPEST_CRUST = (MARS_R - 150000.d0) / MARS_R

! number of hours per day for rotation rate of the planet Mars (24:39:35)
  double precision, parameter :: MARS_HOURS_PER_DAY = 24.658d0
  double precision, parameter :: MARS_SECONDS_PER_HOUR = 3600.d0

! for the stretching of crustal elements in the case of 3D models
  double precision, parameter :: MARS_MAX_RATIO_CRUST_STRETCHING = 0.9d0 ! choose ratio < 1 for stretching effect
  double precision, parameter :: MARS_RMOHO_STRETCH_ADJUSTMENT = 0.d0 ! moho at 110 km
  double precision, parameter :: MARS_R80_STRETCH_ADJUSTMENT =   0.d0 ! r80  at 334.5 km

!!double precision, parameter :: MARS_MAX_RATIO_CRUST_STRETCHING = 0.7d0 ! choose ratio < 1 for stretching effect
!!double precision, parameter :: MARS_RMOHO_STRETCH_ADJUSTMENT = -10000.d0 ! moho down to 120 km
!!double precision, parameter :: MARS_R80_STRETCH_ADJUSTMENT =   -20000.d0 ! r80 down to 120km

! adapted regional moho stretching (use only for special areas to optimize a local mesh)
! 1~6 chunk simulation, 5-layer crust
  logical, parameter :: MARS_REGIONAL_MOHO_MESH = .false.
  logical, parameter :: MARS_HONOR_DEEP_MOHO = .false.


!!-----------------------------------------------------------
!!
!! Moon
!!
!!-----------------------------------------------------------
! Model Moon
!
! mostly based on VPREMOON model:
! Garcia, R.F., J. Gagnepain-Beyneix, S. Chevrot and Ph. Lognonne, 2011.
! Very preliminary reference Moon model,
! Physics of the Earth and Planetary Interiors, 188, 96-113.
!
! NASA fact infos: https://nssdc.gsfc.nasa.gov/planetary/factsheet/moonfact.html
! some of these NASA values are different with respect to the seismologically preferred ones below.
!
! average Moon radius
  double precision, parameter :: MOON_R = 1737100.d0
  double precision, parameter :: R_MOON = MOON_R

! radius of the Moon in km
  double precision, parameter :: MOON_R_KM = MOON_R / 1000.d0
  double precision, parameter :: R_MOON_KM = MOON_R_KM

! average density in the full MOON to normalize equation
  double precision, parameter :: MOON_RHOAV = 3344.0d0    ! from NASA fact sheet

! Topography
!--- 4-minute model
  integer, parameter :: MOON_NX_BATHY_4 = 5400,MOON_NY_BATHY_4 = 2700
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_4 = 4.0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_4 = 'DATA/topo_bathy/topo_bathy_moon4_smoothed_window_0.dat.bin'
!--- 2-minute
  integer, parameter :: MOON_NX_BATHY_2 = 10800,MOON_NY_BATHY_2 = 5400
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_2 = 2.0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_2 = 'DATA/topo_bathy/topo_bathy_moon2_smoothed_window_0.dat.bin'
!--- 1-minute
  integer, parameter :: MOON_NX_BATHY_1 = 21600,MOON_NY_BATHY_1 = 10800
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_1 = 1.0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_1 = 'DATA/topo_bathy/topo_bathy_moon1_smoothed_window_0.dat.bin'
!--- custom resolution < 1-minute model
! size of topography and bathymetry file
  integer, parameter :: MOON_NX_BATHY_C = 23040,MOON_NY_BATHY_C = 11520
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_C = 0.94d0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_C = 'DATA/topo_bathy/interface.bin'
!--- Default
! Topography defaults to 4-minute
  integer, parameter :: MOON_NX_BATHY = MOON_NX_BATHY_4
  integer, parameter :: MOON_NY_BATHY = MOON_NY_BATHY_4
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE = MOON_RESOLUTION_TOPO_FILE_4
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE = MOON_PATHNAME_TOPO_FILE_4

! Topography value min/max range
  integer, parameter :: MOON_TOPO_MINIMUM = -9130 ! (max depth in m)
  integer, parameter :: MOON_TOPO_MAXIMUM = 10780 ! (height in m)

! For the reference ellipsoid to convert geographic latitudes to geocentric:
! Moon flattening:
! NASA fact sheet has flattening = 0.0012 = 1/833.3
!
! Note: Steinberger et al. (2015, PEPI 245, 26-39) argue that due to non-equilibrum flattening of the Moon
!       there is no reference ellipsoid to refer to. Thus, they prefer a sphere with a "frozen"-in shape.
!
!       We could in principle do the same, as the Moon topography is also given in absolute values (radius).
!       However, for now we take topography as the +/- elevation value with respect to a reference surface radius.
!
! For flattening, here preferred: 1/901 = 0.00110987791
  double precision, parameter :: MOON_FLATTENING_F = 1.d0 / 901.0d0
  double precision, parameter :: MOON_ONE_MINUS_F_SQUARED = (1.d0 - MOON_FLATTENING_F)**2

! doubling layers
  double precision, parameter :: MOON_DEPTH_SECOND_DOUBLING_OPTIMAL = 771000.d0    ! between RTOPDDOUBLEPRIME and R771
  double precision, parameter :: MOON_DEPTH_THIRD_DOUBLING_OPTIMAL  = 1380000.d0    ! inside outer core (closer to top)
  double precision, parameter :: MOON_DEPTH_FOURTH_DOUBLING_OPTIMAL = 1420000.d0    ! inside outer core (closer to bottom)

! standard gravity at the surface
  double precision, parameter :: MOON_STANDARD_GRAVITY = 1.62d0 ! in m.s-2

! shortest radius at which crust is implemented (39 km depth)
! we impose the crust only above it
  double precision, parameter :: MOON_R_DEEPEST_CRUST = (MOON_R - 39000.d0) / MOON_R

! number of hours per day for rotation rate of the Moon
  double precision, parameter :: MOON_HOURS_PER_DAY = 27.322d0
  double precision, parameter :: MOON_SECONDS_PER_HOUR = 3600.d0

! for the stretching of crustal elements in the case of 3D models
  double precision, parameter :: MOON_MAX_RATIO_CRUST_STRETCHING = 0.7d0 ! 0.75
  double precision, parameter :: MOON_RMOHO_STRETCH_ADJUSTMENT = -10000.d0 ! moho down
  double precision, parameter :: MOON_R80_STRETCH_ADJUSTMENT =   -20000.d0 ! r80 down

! adapted regional moho stretching (use only for special areas to optimize a local mesh)
  logical, parameter :: MOON_REGIONAL_MOHO_MESH = .false.
  logical, parameter :: MOON_HONOR_DEEP_MOHO = .false.


!!-----------------------------------------------------------
!!
!! Spectral infinite-element mesh
!!
!!-----------------------------------------------------------

! transition-to-infinite and infinite regions
  logical, parameter :: ADD_TRINF = .true.
  integer, parameter :: NLAYER_TRINF = 10           ! default 10

! pole position for infinite element region
! center of the Earth
  double precision, dimension(NDIM), parameter :: POLE_INF = (/ 0.d0, 0.d0, 0.d0 /)
! or
!! center of the source or disturbance
!!  double precision, dimension(NDIM), parameter :: POLE_INF = (/ -0.6334289d0, 0.4764568d0, 0.6045561d0 /)

! degrees of freedoms
  integer, parameter :: NNDOFU   = 0 ! displacement components
  integer, parameter :: NNDOFCHI = 0 ! displacement potential
  integer, parameter :: NNDOFP   = 0 ! pressure
  integer, parameter :: NNDOFPHI = 1 ! gravitational potential

! all nodal freedoms
  integer, parameter :: NNDOF    = NNDOFU + NNDOFCHI + NNDOFP + NNDOFPHI

! number of GLL points in each direction of an element (degree plus one)
  integer, parameter :: NGLLX_INF = 3
  integer, parameter :: NGLLY_INF = NGLLX_INF
  integer, parameter :: NGLLZ_INF = NGLLX_INF
  integer, parameter :: NGLLCUBE_INF = NGLLX_INF * NGLLY_INF * NGLLZ_INF

!------------------------------------------------------------
! Level-1 solver
!------------------------------------------------------------
  integer, parameter :: NEDOFU1   = NGLLCUBE_INF * NNDOFU, &
                        NEDOFCHI1 = NGLLCUBE_INF * NNDOFCHI, &
                        NEDOFP1   = NGLLCUBE_INF * NNDOFP, &
                        NEDOFPHI1 = NGLLCUBE_INF * NNDOFPHI

  integer, parameter :: NEDOF1    = NGLLCUBE_INF * NNDOF

!------------------------------------------------------------
! Level-2 solver
!------------------------------------------------------------
  integer, parameter :: NEDOFU   = NGLLCUBE * NNDOFU, &
                        NEDOFCHI = NGLLCUBE * NNDOFCHI, &
                        NEDOFP   = NGLLCUBE * NNDOFP, &
                        NEDOFPHI = NGLLCUBE * NNDOFPHI

  integer, parameter :: NEDOF    = NGLLCUBE * NNDOF

!!-----------------------------------------------------------
!!
!! Poisson's solver
!!
!!-----------------------------------------------------------

! maximum number of iteration for conjugate gradient solver
  integer, parameter :: ISOLVER_BUILTIN = 0, ISOLVER_PETSC = 1

! Level-2 solver
  logical, parameter :: USE_POISSON_SOLVER_5GLL = .false.

! If the following parameter is .true., contribution of the perturbed gravity is discarded in compute force routines
! (perturbed gravity is still computed from the density perturbation)
  logical, parameter :: DISCARD_GCONTRIB = .false.

[danielpeter]

Dorian, in these two plots the red curves from the latest devel look the same with and without the USE_OLD_VERSION_FORMAT. can you double check if the plots are taking in the correct seismos?

and could you make a comparison where everything model related is turned off, like:

OCEANS                          = .false.
ELLIPTICITY                     = .false.
TOPOGRAPHY                      = .false.
GRAVITY                         = .false.
ROTATION                        = .false.
ATTENUATION                     = .false.

[dosoe]

Hi Daniel,
I just checked, the only difference between the two runs is the value of USE_OLD_VERSION_FORMAT but it is different between the two, eventhough the outputs look identical.
As for running without ellipticity, wouldn't we run into the same problems we ran in earlier, with ellipticity and the geocentric to geographic conversion being handled differently in the old and new codes? At any rate, I am running it and I'll see what comes out of it.
I will also take a close look into the input files, to check that everything is correct in there, as both Par_file and constants.h have been reset to the default values.

[dosoe]

Hi Daniel,
I have checked the input files and noticed that the flag PARTIAL_PHYS_DISPERSION_ONLY was set to .true. . When setting it to .false. the fit becomes much better, but not perfect (first is with USE_OLD_VERSION_FORMAT activated, second with it deactivated). There is still no perceivable difference between the two though, what kind of difference would be expected?


Now I will try to run it with all flags deactivated.

[dosoe]

Hi Daniel,
I just ran both old and new specfem versions, with and without USE_OLD_VERSION_FORMAT activated but with all flags except ELLIPTICITY deactivated. When USE_OLD_VERSION_FORMAT=.false., the fit is not very good:

However, when USE_OLD_VERSION_FORMAT=.true., then the fit is perfect:

This means that the remaining discrepancies are in the other flags. My guess would be on either TOPOGRAPHY or OCEANS but I don't understand the code well enough to make more than a guess.
At any rate, this is a great success, it is the first time we get a perfect fit for the full 3D SemUCB model, even with not all flags active.

[dosoe]

Hi Daniel,
I have run a number of tests, basically testing each flag in isolation (with ellipticity enabled at all times). All these tests are run with USE_OLD_VERSION_FORMAT=.true., PARTIAL_PHYS_DISPERSION_ONLY=.false. and ATTENUATION_1D_WITH_3D_STORAGE=.true.. What these show is that in isolation, rotation, gravity and oceans fit perfectly between the old an new specfem. However, for both topography and attenuation, there are discrepancies that are big enough that they should be addressed. Running just with ellipticity is shown in my previous response, it fits perfectly.
Ellipticity and Topography:

Ellipticity and Attenuation:

[danielpeter]

thanks Dorian! I've added some more steps towards the compatibility to the old version implementation of the SEMUCB model. could you test it again with your example, using the new devel version (with PR SPECFEM/specfem3d_globe#851).

to have the backward compatibility, re-run the ./configure script in the new devel version, then in setup/constants.h change the following parameters:

  logical, parameter :: USE_OLD_VERSION_FORMAT = .true.
..
  double precision, parameter :: MINIMUM_THICKNESS_3D_OCEANS = 100.d0

this should get you closer to the old SEMUCB seismograms, for all possible parameter settings in Par_file.

please note that I had to re-introduce some old SEMUCB hacks that were probably not correct in how things were implemented in the old version. these hacks are only effective when this flag USE_OLD_VERSION_FORMAT is turned on for comparisons:

• mantle model velocities:
  this old line https://github.com/dosoe/Specfem3d_globe_7.0_Berkeley/blob/6e59a04580b853ef9c8f30c29e03b313305c4526/src/meshfem3D/model_berkeley.f90#L377

    if (rho1d<1200.d0)call model_1dberkeley(r_/6367.999d0,rho1d,vpv1d,vph1d,vsv1d,vsh1d,eta1d,Qkappa1d,Qmu1d,iregion_code,CRUSTAL) ! No water in RegSEM please
..

was comparing the value of rho1D which was non-dimensionalized (i.e., rho / EARTH_RHOAV) to 1200.d0. thus, this check basically always evaluates to .true. and the subsequent scaling of r_/6367.999d0 was scaling up the original radius r_. this means that the mantle model was using 1d reference values from slightly up-shifted velocities of the 1D reference model.

• tiso elements:
  another issue in the old version was the assignment of tiso elements. with the USE_FULL_TISO_MANTLE flag set in the Par_file, elements having nodes both above and below the actual moho depth (i.e., where the moho was passing through the element) were missing the tiso flagging and then handled in the solver as isotropic elements. so, the mantle and crust was not fully TISO.

• topography:
  the stretching for topography was handled in a special way to stretch only points above actual moho depths. this might deform elements that have the moho passing through them in a somewhat unexpected way.

• crustal model velocities:
  the crustal model was setting the found_crust flag to always be .true. in line https://github.com/dosoe/Specfem3d_globe_7.0_Berkeley/blob/6e59a04580b853ef9c8f30c29e03b313305c4526/src/meshfem3D/meshfem3D_models.F90#L1614

      call model_berkeley_crust(lat,lon,r,vpc,vsc,rhoc,moho)
      vpvc = vpc
      vphc = vpc
      vsvc = vsc
      vshc = vsc
      found_crust = .true.

so even for GLL points below the actual moho interface, it was always using the "lowest" crustal model velocities instead of the mantle velocities. I'm not sure if this was done on purpose, but the "new" version only assigns now crustal velocities to points at or above the moho interface.

• gravity: the gravity evaluation by default is done using the PREM model since PREM seems to be a good model with respect to total mass constraints of the Earth. the old SEMUCB version was using some incoherent radii for the gravity spline setup and the density tables, affecting the gravity effect in the seismos.

and then the new GLOBE version has a few more improvements independent of SEMUCB:

• attenuation: the ATTENUATION range of the simulation is using higher accuracy values. this leads to slightly different relaxation times for the standard linear solids.
• topography: the elevation values are computed as floating points instead of integer values for higher accuracy.
• ocean load: there were issues with the point normals used on halo points that are shared between different MPI slices. the new version averages those normals to avoid jumps from one slice to another.
• gravity: the spline tables and gravity evaluations adapt to the actual radial size of the Earth when topography and ellipticity is added. this should make the gravity evaluation more accurate in the new version for 3D models.

anyway, please compare with the newest devel version and let me know how your updated comparisons look.

[dosoe]

Hi Daniel,
Thanks for all this work!
I'm trying to run this right now, but I consistently got this error in the mesher:

forrtl: error (65): floating invalid
Image              PC                Routine            Line        Source
xmeshfem3D         00000000006715C4  for__signal_handl     Unknown  Unknown
libpthread-2.28.s  0000154BDD563D20  Unknown               Unknown  Unknown
libucp.so.0.0.0    0000154BDBFCF57F  ucp_proto_perf_en     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFCFA50  ucp_proto_init_pa     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFD08EC  ucp_proto_common_     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFD627C  ucp_proto_multi_i     Unknown  Unknown
libucp.so.0.0.0    0000154BDC00513A  Unknown               Unknown  Unknown
libucp.so.0.0.0    0000154BDBFD6CDB  Unknown               Unknown  Unknown
libucp.so.0.0.0    0000154BDBFD7BB2  Unknown               Unknown  Unknown
libucp.so.0.0.0    0000154BDBFD7DC4  ucp_proto_select_     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFD89A7  ucp_proto_select_     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFC80D8  Unknown               Unknown  Unknown
libucp.so.0.0.0    0000154BDBFC830E  ucp_worker_get_ep     Unknown  Unknown
libucp.so.0.0.0    0000154BDC02EADD  ucp_wireup_init_l     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFB1F75  ucp_ep_create_to_     Unknown  Unknown
libucp.so.0.0.0    0000154BDBFB2714  Unknown               Unknown  Unknown
libucp.so.0.0.0    0000154BDBFB2B8E  ucp_ep_create         Unknown  Unknown
libmpi.so.40.20.6  0000154BDDCEC4BD  mca_pml_ucx_add_p     Unknown  Unknown
libmpi.so.40.20.6  0000154BDDD4B653  ompi_mpi_init         Unknown  Unknown
libmpi.so.40.20.6  0000154BDDBA372E  MPI_Init              Unknown  Unknown
libmpi_mpifh.so.4  0000154BDE088EE7  PMPI_Init_f08         Unknown  Unknown
xmeshfem3D         0000000000457BC8  Unknown               Unknown  Unknown
xmeshfem3D         0000000000499915  Unknown               Unknown  Unknown
xmeshfem3D         000000000040D2E2  Unknown               Unknown  Unknown
libc-2.28.so       0000154BDD1B57E5  __libc_start_main     Unknown  Unknown
xmeshfem3D         000000000040D1EE  Unknown               Unknown  Unknown

repeated over and over again. The only thing I modified with respect to my previous run is that:

• Some of the parameters like STF_IS_UCB_HEAVISIDE got transferred to the Par_file
• I used the constants.h created by running ./configure just modifying the parts relevant for the berkeley model (around line 250), USE_OLD_VERSION_FORMAT and MINIMUM_THICKNESS_3D_OCEANS as you suggested. Do you have an idea what could be the problem?
  Here is my Par_file:

#-----------------------------------------------------------
#
# Simulation input parameters
#
#-----------------------------------------------------------

# forward or adjoint simulation
SIMULATION_TYPE                 = 1   # set to 1 for forward simulations, 2 for adjoint simulations for sources, and 3 for kernel simulations
NOISE_TOMOGRAPHY                = 0   # flag of noise tomography, three steps (1,2,3). If earthquake simulation, set it to 0.
SAVE_FORWARD                    = .false.   # save last frame of forward simulation or not

# number of chunks (1,2,3 or 6)
NCHUNKS                         = 6

# angular width of the first chunk (not used if full sphere with six chunks)
ANGULAR_WIDTH_XI_IN_DEGREES     = 20.d0   # angular size of a chunk
ANGULAR_WIDTH_ETA_IN_DEGREES    = 20.d0
CENTER_LATITUDE_IN_DEGREES      = 40.d0
CENTER_LONGITUDE_IN_DEGREES     = 25.d0
GAMMA_ROTATION_AZIMUTH          = 0.d0

# number of elements at the surface along the two sides of the first chunk
# (must be multiple of 16 and 8 * multiple of NPROC below)
NEX_XI                          = 112
NEX_ETA                         = 112

# number of MPI processors along the two sides of the first chunk
NPROC_XI                        = 7
NPROC_ETA                       = 7

#-----------------------------------------------------------
#
# Model
#
#-----------------------------------------------------------

# 1D models with real structure:
# 1D_isotropic_prem, 1D_transversely_isotropic_prem, 1D_iasp91, 1D_1066a, 1D_ak135f_no_mud, 1D_ref, 1D_ref_iso, 1D_jp3d,1D_sea99
#
# 1D models with only one fictitious averaged crustal layer:
# 1D_isotropic_prem_onecrust, 1D_transversely_isotropic_prem_onecrust, 1D_iasp91_onecrust, 1D_1066a_onecrust, 1D_ak135f_no_mud_onecrust
#
# fully 3D models:
# transversely_isotropic_prem_plus_3D_crust_2.0, 3D_anisotropic, 3D_attenuation,
# s20rts, s40rts, s362ani, s362iso, s362wmani, s362ani_prem, s362ani_3DQ, s362iso_3DQ,
# s29ea, sea99_jp3d1994, sea99, jp3d1994, heterogen, full_sh, sgloberani_aniso, sgloberani_iso
#
# 3D crustal models:
# crust1.0, crust2.0, EPcrust, EuCRUST, crustmaps, crustSH
#
# Mars models:
# 1D_Sohl, 1D_Sohl_3D_crust, 1D_case65TAY, 1D_case65TAY_3D_crust, mars_1D, mars_1D_3D_crust
#
# Moon models:
# vpremoon
#
# 3D models with 3D crust: append "_**crustname**" to the mantle model name
#                          to take a 3D crustal model (by default crust2.0 is taken for 3D mantle models)
#                          e.g. s20rts_crust1.0, s362ani_crustmaps, full_sh_crustSH, sglobe_EPcrust, etc.
#
# 3D models with 1D crust: append "_1Dcrust" to the 3D model name
#                          to take the 1D crustal model from the
#                          associated reference model rather than the default 3D crustal model
#                          e.g. s20rts_1Dcrust, s362ani_1Dcrust, etc.
#
MODEL                           = semucb_a3d

# parameters describing the Earth model
OCEANS                          = .true.
ELLIPTICITY                     = .true.
TOPOGRAPHY                      = .true.
GRAVITY                         = .true.
ROTATION                        = .true.
ATTENUATION                     = .true.

# full gravity calculation by solving Poisson's equation for gravity potential instead of using a Cowling approximation
# (must have also GRAVITY flag set to .true. to become active)
FULL_GRAVITY                    = .false.
# for full gravity calculation, set to 0 == builtin or 1 == PETSc Poisson solver
# (the PETSc solver option needs the PETSc library installed; code configuration --with-petsc)
POISSON_SOLVER                  = 0

# record length in minutes
RECORD_LENGTH_IN_MINUTES        = 100.d0

#-----------------------------------------------------------
#
# Mesh
#
#-----------------------------------------------------------

## regional mesh cut-off
# using this flag will cut-off the mesh in the mantle at a layer matching to the given cut-off depth.
# this flag only has an effect for regional simulations, i.e., for NCHUNKS values less than 6.
REGIONAL_MESH_CUTOFF            = .false.

# regional mesh cut-off depth (in km)
# possible selections are: 24.4d0, 80.d0, 220.d0, 400.d0, 600.d0, 670.d0, 771.d0
REGIONAL_MESH_CUTOFF_DEPTH      = 400.d0

# regional mesh cut-off w/ a second doubling layer below 220km interface
# (by default, a first doubling layer will be added below the Moho, and a second one below the 771km-depth layer.
#  Setting this flag to .true., will move the second one below the 220km-depth layer for regional mesh cut-offs only.)
REGIONAL_MESH_ADD_2ND_DOUBLING  = .false.

#-----------------------------------------------------------
#
# Absorbing boundary conditions
#
#-----------------------------------------------------------

# absorbing boundary conditions for a regional simulation
ABSORBING_CONDITIONS            = .false.

# run global simulation for a circular region and apply high attenuation for the rest of the model
# this creates an absorbing boundary with less reflection than stacey at a cost of 6x the computational cost
# NCHUNKS must be set to 6 to enable this flag
ABSORB_USING_GLOBAL_SPONGE      = .false.

# location and size of the region with no sponge (the region to run simulation)
SPONGE_LATITUDE_IN_DEGREES      = 40.d0
SPONGE_LONGITUDE_IN_DEGREES     = 25.d0
SPONGE_RADIUS_IN_DEGREES        = 25.d0

#-----------------------------------------------------------
#
# undoing attenuation for sensitivity kernel calculations
#
#-----------------------------------------------------------

# to undo attenuation for sensitivity kernel calculations or forward runs with SAVE_FORWARD
# use one (and only one) of the two flags below. UNDO_ATTENUATION is much better (it is exact)
# but requires a significant amount of disk space for temporary storage.
PARTIAL_PHYS_DISPERSION_ONLY    = .false.
UNDO_ATTENUATION                = .false.

## undo attenuation memory
# How much memory (in GB) is installed on your machine per CPU core
# (only used for UNDO_ATTENUATION, can be ignored otherwise)
# Beware, this value MUST be given per core, i.e. per MPI thread, i.e. per MPI rank, NOT per node.
# This value is for instance:
#   -  4 GB on Tiger at Princeton
#   -  4 GB on TGCC Curie in Paris
#   -  4 GB on Titan at ORNL when using CPUs only (no GPUs); start your run with "aprun -n$NPROC -N8 -S4 -j1"
#   -  2 GB on the machine used by Christina Morency
#   -  2 GB on the TACC machine used by Min Chen
#   -  1.5 GB on the GPU cluster in Marseille
# When running on GPU machines, it is simpler to set PERCENT_OF_MEM_TO_USE_PER_CORE = 100.d0
# and then set MEMORY_INSTALLED_PER_CORE_IN_GB to the amount of memory that you estimate is free (rather than installed)
# on the host of the GPU card while running your GPU job.
# For GPU runs on Titan at ORNL, use PERCENT_OF_MEM_TO_USE_PER_CORE = 100.d0 and MEMORY_INSTALLED_PER_CORE_IN_GB = 25.d0
# and run your job with "aprun -n$NPROC -N1 -S1 -j1"
# (each host has 32 GB on Titan, each GPU has 6 GB, thus even if all the GPU arrays are duplicated on the host
#  this leaves 32 - 6 = 26 GB free on the host; leaving 1 GB for the Linux system, we can safely use 100% of 25 GB)
MEMORY_INSTALLED_PER_CORE_IN_GB = 4.d0
# What percentage of this total do you allow us to use for arrays to undo attenuation, keeping in mind that you
# need to leave some memory available for the GNU/Linux system to run
# (a typical value is 85%; any value below is fine but the code will then save a lot of data to disk;
#  values above, say 90% or 92%, can be OK on some systems but can make the adjoint code run out of memory
#  on other systems, depending on how much memory per node the GNU/Linux system needs for itself; thus you can try
#  a higher value and if the adjoint crashes then try again with a lower value)
PERCENT_OF_MEM_TO_USE_PER_CORE  = 85.d0

## exact mass matrices for rotation
# three mass matrices instead of one are needed to handle rotation very accurately;
# otherwise rotation is handled slightly less accurately (but still reasonably well);
# set to .true. if you are interested in precise effects related to rotation;
# set to .false. if you are solving very large inverse problems at high frequency and also undoing attenuation exactly
#
# using the UNDO_ATTENUATION flag above, in which case saving as much memory as possible can be a good idea.
# You can also safely set it to .false. if you are not in a period range in which rotation matters,
# e.g. if you are targetting very short-period body waves. if in doubt, set to .true.
#
# You can safeely set it to .true. if you have ABSORBING_CONDITIONS above, because in that case the code
# will use three mass matrices anyway and thus there is no additional memory cost.
# this flag is of course unused if ROTATION above is set to .false.
EXACT_MASS_MATRIX_FOR_ROTATION  = .false.

#-----------------------------------------------------------
#
# LDDRK time scheme
#
#-----------------------------------------------------------

# this for LDDRK high-order time scheme instead of Newmark
USE_LDDRK                       = .false.

# the maximum CFL of LDDRK is significantly higher than that of the Newmark scheme,
# in a ratio that is theoretically 1.327 / 0.697 = 1.15 / 0.604 = 1.903 for a solid with Poisson's ratio = 0.25
# and for a fluid (see the manual of the 2D code, SPECFEM2D, Tables 4.1 and 4.2, and that ratio does not
# depend on whether we are in 2D or in 3D). However in practice a ratio of about 1.5 to 1.7 is often safer
# (for instance for models with a large range of Poisson's ratio values).
# Since the code computes the time step using the Newmark scheme, for LDDRK we will simply
# multiply that time step by this ratio when LDDRK is on and when flag INCREASE_CFL_FOR_LDDRK is true.
INCREASE_CFL_FOR_LDDRK          = .true.
RATIO_BY_WHICH_TO_INCREASE_IT   = 1.5d0

#-----------------------------------------------------------
#
# Visualization
#
#-----------------------------------------------------------

# save AVS or OpenDX movies
#MOVIE_COARSE saves movie only at corners of elements (SURFACE OR VOLUME)
#MOVIE_COARSE does not work with create_movie_AVS_DX
MOVIE_SURFACE                   = .false.
MOVIE_VOLUME                    = .false.
MOVIE_COARSE                    = .true.
NTSTEP_BETWEEN_FRAMES           = 50
HDUR_MOVIE                      = 0.d0

# save movie in volume.  Will save element if center of element is in prescribed volume
# top/bottom: depth in KM, use MOVIE_TOP = -100 to make sure the surface is stored.
# west/east: longitude, degrees East [-180/180] top/bottom: latitute, degrees North [-90/90]
# start/stop: frames will be stored at MOVIE_START + i*NSTEP_BETWEEN_FRAMES, where i=(0,1,2..) and iNSTEP_BETWEEN_FRAMES <= MOVIE_STOP
# movie_volume_type: 1=strain, 2=time integral of strain, 3=\mu*time integral of strain
# type 4 saves the trace and deviatoric stress in the whole volume, 5=displacement, 6=velocity
MOVIE_VOLUME_TYPE               = 2
MOVIE_TOP_KM                    = -100.0
MOVIE_BOTTOM_KM                 = 1000.0
MOVIE_WEST_DEG                  = -90.0
MOVIE_EAST_DEG                  = 90.0
MOVIE_NORTH_DEG                 = 90.0
MOVIE_SOUTH_DEG                 = -90.0
MOVIE_START                     = 0
MOVIE_STOP                      = 40000

# save mesh files to check the mesh
SAVE_MESH_FILES                 = .true.

# restart files (number of runs can be 1 or higher, choose 1 for no restart files)
NUMBER_OF_RUNS                  = 1
NUMBER_OF_THIS_RUN              = 1

# path to store the local database files on each node
LOCAL_PATH                      = ./DATABASES_MPI
# temporary wavefield/kernel/movie files
LOCAL_TMP_PATH                  = ./DATABASES_MPI

# interval at which we output time step info and max of norm of displacement
NTSTEP_BETWEEN_OUTPUT_INFO      = 500

#-----------------------------------------------------------
#
# Sources
#
#-----------------------------------------------------------

# use a (tilted) FORCESOLUTION force point source (or several) instead of a CMTSOLUTION moment-tensor source.
# This can be useful e.g. for asteroid simulations
# in which the source is a vertical force, normal force, tilted force, impact etc.
# If this flag is turned on, the FORCESOLUTION file must be edited by giving:
# - the corresponding time-shift parameter,
# - the half duration parameter of the source,
# - the coordinates of the source,
# - the source time function of the source,
# - the magnitude of the force source,
# - the components of a (non necessarily unitary) direction vector for the force source in the E/N/Z_UP basis.
# The direction vector is made unitary internally in the code and thus only its direction matters here;
# its norm is ignored and the norm of the force used is the factor force source times the source time function.
USE_FORCE_POINT_SOURCE          = .false.

# use monochromatic source time function for CMTSOLUTION moment-tensor source.
# half duration is interpreted as a PERIOD just to avoid changing CMTSOLUTION file format
# default is .false. which uses Heaviside function
USE_MONOCHROMATIC_CMT_SOURCE    = .false.

# print source time function
PRINT_SOURCE_TIME_FUNCTION      = .false.

## Berkeley source time function
STF_IS_UCB_HEAVISIDE            = .true.
# UCB source frequency content (i.e., heaviside function)
SOURCE_T1                       = 500.d0
SOURCE_T2                       = 400.d0
SOURCE_T3                       =  50.d0
SOURCE_T4                       =  40.d0
# UCB source time shift
TAU                             = 500.d0

#-----------------------------------------------------------
#
# Seismograms
#
#-----------------------------------------------------------

# interval in time steps for temporary writing of seismograms
NTSTEP_BETWEEN_OUTPUT_SEISMOS   = 5000000

# set to n to reduce the sampling rate of output seismograms by a factor of n
# defaults to 1, which means no down-sampling
NTSTEP_BETWEEN_OUTPUT_SAMPLE    = 1

# option to save strain seismograms
# this option is useful for strain Green's tensor
# this feature is currently under development
SAVE_SEISMOGRAMS_STRAIN         = .false.

# save seismograms also when running the adjoint runs for an inverse problem
# (usually they are unused and not very meaningful, leave this off in almost all cases)
SAVE_SEISMOGRAMS_IN_ADJOINT_RUN = .false.

# output format for the seismograms (one can use either or all of the three formats)
OUTPUT_SEISMOS_ASCII_TEXT       = .true.
OUTPUT_SEISMOS_SAC_ALPHANUM     = .false.
OUTPUT_SEISMOS_SAC_BINARY       = .false.
OUTPUT_SEISMOS_ASDF             = .false.
OUTPUT_SEISMOS_3D_ARRAY         = .false.

# rotate seismograms to Radial-Transverse-Z or use default North-East-Z reference frame
ROTATE_SEISMOGRAMS_RT           = .false.

# decide if main process writes all the seismograms or if all processes do it in parallel
WRITE_SEISMOGRAMS_BY_MAIN       = .false.

# save all seismograms in one large combined file instead of one file per seismogram
# to avoid overloading shared non-local file systems such as LUSTRE or GPFS for instance
SAVE_ALL_SEISMOS_IN_ONE_FILE    = .false.
USE_BINARY_FOR_LARGE_FILE       = .false.

# flag to impose receivers at the surface or allow them to be buried
RECEIVERS_CAN_BE_BURIED         = .false.

#-----------------------------------------------------------
#
#  Adjoint kernel outputs
#
#-----------------------------------------------------------

# interval in time steps for reading adjoint traces
# 0 = read the whole adjoint sources at start time
NTSTEP_BETWEEN_READ_ADJSRC      = 0

# use ASDF format for reading the adjoint sources
READ_ADJSRC_ASDF                = .false.

# this parameter must be set to .true. to compute anisotropic kernels
# in crust and mantle (related to the 21 Cij in geographical coordinates)
# default is .false. to compute isotropic kernels (related to alpha and beta)
ANISOTROPIC_KL                  = .false.

# output only transverse isotropic kernels (alpha_v,alpha_h,beta_v,beta_h,eta,rho)
# rather than fully anisotropic kernels when ANISOTROPIC_KL above is set to .true.
# means to save radial anisotropic kernels, i.e., sensitivity kernels for beta_v, beta_h, etc.
SAVE_TRANSVERSE_KL_ONLY         = .false.

# output only the kernels used for the current azimuthally anisotropic inversions of surface waves,
# i.e., bulk_c, bulk_betav, bulk_betah, eta, Gc_prime, Gs_prime and rho
# (Gc' & Gs' which are the normalized Gc & Gs kernels by isotropic \rho\beta of the 1D reference model)
SAVE_AZIMUTHAL_ANISO_KL_ONLY    = .false.

# output approximate Hessian in crust mantle region.
# means to save the preconditioning for gradients, they are cross correlations between forward and adjoint accelerations.
APPROXIMATE_HESS_KL             = .false.

# forces transverse isotropy for all mantle elements
# (default is to use transverse isotropy only between crust and 220)
# means we allow radial anisotropy throughout the whole crust/mantle region
USE_FULL_TISO_MANTLE            = .true.

# output kernel mask to zero out source region
# to remove large values near the sources in the sensitivity kernels
SAVE_SOURCE_MASK                = .false.

# output kernels on a regular grid instead of on the GLL mesh points (a bit expensive)
SAVE_REGULAR_KL                 = .false.

# compute steady state kernels for source encoding
STEADY_STATE_KERNEL             = .false.
STEADY_STATE_LENGTH_IN_MINUTES  = 0.d0

#-----------------------------------------------------------

# Dimitri Komatitsch, July 2014, CNRS Marseille, France:
# added the ability to run several calculations (several earthquakes)
# in an embarrassingly-parallel fashion from within the same run;
# this can be useful when using a very large supercomputer to compute
# many earthquakes in a catalog, in which case it can be better from
# a batch job submission point of view to start fewer and much larger jobs,
# each of them computing several earthquakes in parallel.
# To turn that option on, set parameter NUMBER_OF_SIMULTANEOUS_RUNS to a value greater than 1.
# To implement that, we create NUMBER_OF_SIMULTANEOUS_RUNS MPI sub-communicators,
# each of them being labeled "my_local_mpi_comm_world", and we use them
# in all the routines in "src/shared/parallel.f90", except in MPI_ABORT() because in that case
# we need to kill the entire run.
# When that option is on, of course the number of processor cores used to start
# the code in the batch system must be a multiple of NUMBER_OF_SIMULTANEOUS_RUNS,
# all the individual runs must use the same number of processor cores,
# which as usual is NPROC in the Par_file,
# and thus the total number of processor cores to request from the batch system
# should be NUMBER_OF_SIMULTANEOUS_RUNS * NPROC.
# All the runs to perform must be placed in directories called run0001, run0002, run0003 and so on
# (with exactly four digits).
#
# Imagine you have 10 independent calculations to do, each of them on 100 cores; you have three options:
#
# 1/ submit 10 jobs to the batch system
#
# 2/ submit a single job on 1000 cores to the batch, and in that script create a sub-array of jobs to start 10 jobs,
# each running on 100 cores (see e.g. http://www.schedmd.com/slurmdocs/job_array.html )
#
# 3/ submit a single job on 1000 cores to the batch, start SPECFEM3D on 1000 cores, create 10 sub-communicators,
# cd into one of 10 subdirectories (called e.g. run0001, run0002,... run0010) depending on the sub-communicator
# your MPI rank belongs to, and run normally on 100 cores using that sub-communicator.
#
# The option below implements 3/.
#
NUMBER_OF_SIMULTANEOUS_RUNS     = 1

# if we perform simultaneous runs in parallel, if only the source and receivers vary between these runs
# but not the mesh nor the model (velocity and density) then we can also read the mesh and model files
# from a single run in the beginning and broadcast them to all the others; for a large number of simultaneous
# runs for instance when solving inverse problems iteratively this can DRASTICALLY reduce I/Os to disk in the solver
# (by a factor equal to NUMBER_OF_SIMULTANEOUS_RUNS), and reducing I/Os is crucial in the case of huge runs.
# Thus, always set this option to .true. if the mesh and the model are the same for all simultaneous runs.
# In that case there is no need to duplicate the mesh and model file database (the content of the DATABASES_MPI
# directories) in each of the run0001, run0002,... directories, it is sufficient to have one in run0001
# and the code will broadcast it to the others)
BROADCAST_SAME_MESH_AND_MODEL   = .false.

#-----------------------------------------------------------

# set to true to use GPUs
GPU_MODE                        = .false.
# Only used if GPU_MODE = .true. :
GPU_RUNTIME                     = 1
# 2 (OpenCL), 1 (Cuda) ou 0 (Compile-time -- does not work if configured with --with-cuda *AND* --with-opencl)
GPU_PLATFORM                    = NVIDIA
GPU_DEVICE                      = Tesla

# set to true to use the ADIOS library for I/Os
ADIOS_ENABLED                   = .false.
ADIOS_FOR_FORWARD_ARRAYS        = .true.
ADIOS_FOR_MPI_ARRAYS            = .true.
ADIOS_FOR_ARRAYS_SOLVER         = .true.
ADIOS_FOR_SOLVER_MESHFILES      = .true.
ADIOS_FOR_AVS_DX                = .true.
ADIOS_FOR_KERNELS               = .true.
ADIOS_FOR_MODELS                = .true.
ADIOS_FOR_UNDO_ATTENUATION      = .true.

and here is my constants.h file ( I created it using ./configure so it should be fine):

!=====================================================================
!
!                       S p e c f e m 3 D  G l o b e
!                       ----------------------------
!
!     Main historical authors: Dimitri Komatitsch and Jeroen Tromp
!                        Princeton University, USA
!                and CNRS / University of Marseille, France
!                 (there are currently many more authors!)
! (c) Princeton University and CNRS / University of Marseille, April 2014
!
! This program is free software; you can redistribute it and/or modify
! it under the terms of the GNU General Public License as published by
! the Free Software Foundation; either version 3 of the License, or
! (at your option) any later version.
!
! This program is distributed in the hope that it will be useful,
! but WITHOUT ANY WARRANTY; without even the implied warranty of
! MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
! GNU General Public License for more details.
!
! You should have received a copy of the GNU General Public License along
! with this program; if not, write to the Free Software Foundation, Inc.,
! 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA.
!
!=====================================================================

! setup/constants.h.  Generated from constants.h.in by configure.

!
!--- user can modify parameters below
!

!
! solver in single or double precision depending on the machine (4 or 8 bytes)
!
!  ALSO CHANGE FILE precision.h ACCORDINGLY
!
  integer, parameter :: SIZE_REAL = 4, SIZE_DOUBLE = 8

! usually the size of integer and logical variables is the same as regular single-precision real variable
  integer, parameter :: SIZE_INTEGER = SIZE_REAL
  integer, parameter :: SIZE_LOGICAL = SIZE_REAL

! set to SIZE_REAL to run in single precision
! set to SIZE_DOUBLE to run in double precision (increases memory size by 2)
  integer, parameter :: CUSTOM_REAL = SIZE_REAL

!*********************************************************************************************************

!!-----------------------------------------------------------
!!
!! Gauss-Lobatto-Legendre resolution
!!
!!-----------------------------------------------------------
! number of GLL points in each direction of an element (degree plus one)
  integer, parameter :: NGLLX = 5
  integer, parameter :: NGLLY = NGLLX
  integer, parameter :: NGLLZ = NGLLX


!!-----------------------------------------------------------
!!
!! Energy
!!
!!-----------------------------------------------------------
!! added this temporarily here to make SPECFEM3D and SPECFEM3D_GLOBE much more similar
!! in terms of the structure of their main time iteration loop; these are future features
!! that are missing in this code but implemented in the other and that could thus be cut and pasted one day
  logical, parameter :: OUTPUT_ENERGY = .false.
  integer, parameter :: IOUT_ENERGY = 937  ! file number for the energy file
  logical, parameter :: GRAVITY_SIMULATION = .false.


!!-----------------------------------------------------------
!!
!! new version compatibility
!!
!!-----------------------------------------------------------
! for comparison against older versions
! in version 7.0: tiso was constrained to below moho, new version allows also in crust
! in version 8.0: conversions between geodetic & geocentric latitudes were always applied,
!                 and additional differences in 1-chunk centering & source positioning
  logical, parameter :: USE_OLD_VERSION_FORMAT = .true.


!!-----------------------------------------------------------
!!
!! I/O
!!
!!-----------------------------------------------------------

! if files on a local path on each node are also seen as global with same path
! set to .true. typically on a machine with a common (shared) file system, e.g. LUSTRE, GPFS or NFS-mounted /home
! set to .false. typically on a cluster of nodes with local disks used to store the mesh (not very common these days)
! if running on a cluster of nodes with local disks, also customize global path
! to local files in create_serial_name_database.f90 ("20 format ...")
! Flag is used only when one checks the mesh with the serial codes
! ("xcheck_buffers_1D" etc.), ignore it if you do not plan to use them
  logical, parameter :: LOCAL_PATH_IS_ALSO_GLOBAL = .true.

! maximum length of strings used for paths, reading from files, etc.
  integer, parameter :: MAX_STRING_LEN = 512

! input, output and main MPI I/O files
! note: careful with these unit numbers, we mostly use units in the 40-50 range.
!       Cray Fortran e.g. reserves 0,5,6 (standard error,input,output units) and 100,101,102 (input,output,error unit)
  integer, parameter :: ISTANDARD_OUTPUT = 6     ! or for cray: 101
! I/O unit for file input,output
  integer, parameter :: IIN = 40,IOUT = 41
! uncomment this to write messages to a text file
  integer, parameter :: IMAIN = 42
! uncomment this to write messages to the screen (slows down the code)
! integer, parameter :: IMAIN = ISTANDARD_OUTPUT

! I/O unit for noise data files
  integer, parameter :: IIN_NOISE = 43,IOUT_NOISE = 44
! I/O unit for adjoint source files
  integer, parameter :: IIN_ADJ = 45
! local file unit for output of buffers
  integer, parameter :: IOUT_BUFFERS = 46
! I/O unit for source and receiver vtk file
  integer, parameter :: IOUT_VTK = 47
! I/O unit for sac files
  integer, parameter :: IOUT_SAC = 48

!!-----------------------------------------------------------
!!
!! Earth
!!
!!-----------------------------------------------------------
! EARTH_R is the radius of the bottom of the oceans (radius of Earth in m)
  double precision, parameter :: EARTH_R = 6371000.d0
! uncomment line below for PREM with oceans
! double precision, parameter :: EARTH_R = 6368000.d0

! radius of the Earth in km
  double precision, parameter :: EARTH_R_KM = EARTH_R / 1000.d0

! average density in the full Earth to normalize equation
  double precision, parameter :: EARTH_RHOAV = 5514.3d0

!!-----------------------------------------------------------
!!
!! for topography/bathymetry model
!!
!!-----------------------------------------------------------
!--- ETOPO5 5-minute model, smoothed Harvard version (not provided in package, see DATA/topo_bathy/ for more infos)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_5 = 4320,NY_BATHY_5 = 2160
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_5 = 5.0
! pathname of the topography file
  character (len=*), parameter :: PATHNAME_TOPO_FILE_5 = &
    'DATA/topo_bathy/topo_bathy_etopo5_smoothed_Harvard.dat'

!---  ETOPO4 4-minute model (default)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_4 = 5400,NY_BATHY_4 = 2700
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_4 = 4.0
! pathname of the topography file
! character (len=*), parameter :: PATHNAME_TOPO_FILE_4 = &
!    'DATA/topo_bathy/topo_bathy_etopo4_from_etopo2_subsampled.bin'
  character (len=*), parameter :: PATHNAME_TOPO_FILE_4 = &
    'DATA/topo_bathy/topo_bathy_etopo4_smoothed_window_7.bin'

!--- ETOPO2 2-minute model (not provided in package, see DATA/topo_bathy/ for more infos)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_2 = 10800,NY_BATHY_2 = 5400
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_2 = 2.0
! pathname of the topography file
! character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
!    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_resampled_at_2minutes_original_unmodified_unsmoothed.bin'
! character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
!    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_resampled_at_2minutes_smoothed_window_3.bin'
! character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
!    'DATA/topo_bathy/topo_bathy_etopo2v2c_original_unmodified_unsmoothed.bin'
  character (len=*), parameter :: PATHNAME_TOPO_FILE_2 = &
    'DATA/topo_bathy/topo_bathy_etopo2v2c_smoothed_window_3.bin'

!--- ETOPO1 1-minute model (not provided in package, see DATA/topo_bathy/ for more infos)
! size of topography and bathymetry file
  integer, parameter :: NX_BATHY_1 = 21600,NY_BATHY_1 = 10800
! resolution of topography file in minutes
  double precision, parameter :: RESOLUTION_TOPO_FILE_1 = 1.0
! pathname of the topography file
!  character (len=*), parameter :: PATHNAME_TOPO_FILE_1 = &
!    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_original_unmodified_unsmoothed.bin'
  character (len=*), parameter :: PATHNAME_TOPO_FILE_1 = &
    'DATA/topo_bathy/topo_bathy_etopo1_ice_c_smoothed_window_3.bin'

!!--- Default
! Topography defaults to ETOPO4
!  integer, parameter :: EARTH_NX_BATHY = NX_BATHY_4
!  integer, parameter :: EARTH_NY_BATHY = NY_BATHY_4
!  double precision, parameter :: EARTH_RESOLUTION_TOPO_FILE = RESOLUTION_TOPO_FILE_4
!  character (len=*), parameter :: EARTH_PATHNAME_TOPO_FILE = PATHNAME_TOPO_FILE_4

! For the reference ellipsoid to convert geographic latitudes to geocentric:
!
! From Dahlen and Tromp (1998): "Spherically-symmetric Earth models all have the same hydrostatic
! surface ellipticity 1/299.8. This is 0.5 percent smaller than observed flattening of best-fitting ellipsoid 1/298.3.
! The discrepancy is referred to as the "excess equatorial bulge of the Earth",
! an early discovery of artificial satellite geodesy."
!
! From Paul Melchior, IUGG General Assembly, Vienna, Austria, August 1991 Union lecture,
! available at http://www.agu.org/books/sp/v035/SP035p0047/SP035p0047.pdf :
! "It turns out that the spheroidal models constructed on the basis of the spherically-symmetric models (PREM, 1066A)
! by using the Clairaut differential equation to calculate the flattening in function of the radius vector imply hydrostaticity.
! These have surface ellipticity 1/299.8 and a corresponding dynamical flattening of .0033 (PREM).
! The actual ellipticty of the Earth for a best-fitting ellipsoid is 1/298.3 with a corresponding dynamical flattening of .0034."
!
! Thus, flattening f = 1/299.8 is what is used in SPECFEM3D_GLOBE, as it should.
! And thus eccentricity squared e^2 = 1 - (1-f)^2 = 1 - (1 - 1/299.8)^2 = 0.00665998813529,
! and the correction factor used in the code to convert geographic latitudes to geocentric
! is 1 - e^2 = (1-f)^2 = (1 - 1/299.8)^2 = 0.9933400118647.
!
! As a comparison, the classical World Geodetic System reference ellipsoid WGS 84
! (see e.g. http://en.wikipedia.org/wiki/World_Geodetic_System) has f = 1/298.2572236.
  double precision, parameter :: EARTH_FLATTENING_F = 1.d0 / 299.8d0
  double precision, parameter :: EARTH_ONE_MINUS_F_SQUARED = (1.d0 - EARTH_FLATTENING_F)**2

! Use GLL points to capture TOPOGRAPHY and ELLIPTICITY (experimental feature, currently does not work, DO NOT USE)
  logical, parameter :: USE_GLL = .false.

! the code will print an error message and stop if it finds that the topography input file
! contains values outside this range.
! we take a safety margin just in case of a smoothed or modified model, which can locally create slightly different values
  integer, parameter :: EARTH_TOPO_MINIMUM = - 11200 ! (max depth in m, Mariana trench)
  integer, parameter :: EARTH_TOPO_MAXIMUM = + 9000 ! (height in m, Mount Everest)

! minimum thickness in meters to include the effect of the oceans and topo
  double precision, parameter :: MINIMUM_THICKNESS_3D_OCEANS = 100.d0

! plots pnm-image (showing used topography)
! file can become fairly big for large topo-files, e.g. ETOPO1 creates a ~2.7 GB pnm-image
  logical,parameter :: PLOT_PNM_IMAGE_TOPO_BATHY = .false.


!!-----------------------------------------------------------
!!
!! for Berkeley model
!!
!!-----------------------------------------------------------

! Path to A3d model
! Make sure this line ends on "/"
  character (len=*), parameter :: A3d_folder = "DATA/SEMUCB_A3d/"

! topography model
!!--- ETOPO1 5 - Berkeley filtered
! size of topography and bathymetry file
! note: NX = 360     to match longitude range [0,360[ , i.e., 0,1,2,..,359
!       NY = 180 + 1 to match colatitude range [0,180], i.e., 0,1,2,..,180
  integer, parameter :: NX_BATHY_BERKELEY = 360,NY_BATHY_BERKELEY = 181
! resolution of topography file in minutes (1 degree == 60 minutes)
  integer, parameter :: RESOLUTION_TOPO_FILE_BERKELEY = 60
! pathname of the topography file (un-smoothed)
  character (len=*), parameter :: PATHNAME_TOPO_FILE_BERKELEY = trim(A3d_folder)//"ETOPO5_1x1_filtre.dat"

!! uncomment this only to use Berkeley topography as default for all other Earth models as well
!! note: Berkeley topography setting is used by default for SEMUCB model (see in get_model_parameters.F90 file).
!!       uncommenting the lines below here (- and commenting out corresponding parameters in the topo/bathy section above)
!!       will force the Berkeley topo to be used as the default topography for all Earth models.
!! Topography defaults to Berkeley
  integer, parameter :: EARTH_NX_BATHY = NX_BATHY_BERKELEY
  integer, parameter :: EARTH_NY_BATHY = NY_BATHY_BERKELEY
  double precision, parameter :: EARTH_RESOLUTION_TOPO_FILE = RESOLUTION_TOPO_FILE_BERKELEY
  character (len=*), parameter :: EARTH_PATHNAME_TOPO_FILE = PATHNAME_TOPO_FILE_BERKELEY

! Save mirror files - not implemented yet
!  logical, parameter :: SAVE_MIRRORS = .false.


!!-----------------------------------------------------------
!!
!! for crustal model
!!
!!-----------------------------------------------------------
!! (uncomment desired model)

! crustal model cap smoothing - extension range in degree
! note: using a smaller range, e.g. 0.5 degrees, leads to undefined Jacobian error at different places.
!       this is probably due to stretching elements below sharp gradients, especially with deep moho values.
!       so far, the only thing that works is to smooth out values and take special care of the Andes...
! TODO: one could try to adapt this degree range to the simulation resolution in the future
  double precision, parameter :: CAP_SMOOTHING_DEGREE_DEFAULT = 1.0d0

! increase smoothing for critical regions (for instance high mountains in Europe and in the Andes) to increases mesh stability
  logical, parameter :: SMOOTH_CRUST_EVEN_MORE = .true.

! use sedimentary layers in crustal model
  logical, parameter :: INCLUDE_SEDIMENTS_IN_CRUST = .true.
  logical, parameter :: INCLUDE_ICE_IN_CRUST       = .false. ! always set this to false except for gravity integral calculations
  double precision, parameter :: MINIMUM_SEDIMENT_THICKNESS = 2.d0 ! minimim thickness in km


!!-----------------------------------------------------------
!!
!! source/receiver setup
!!
!!-----------------------------------------------------------

! flag to exclude elements that are too far from target in source detection
  logical, parameter :: USE_DISTANCE_CRITERION = .true.

! flag to display detailed information about location of stations
  logical, parameter :: DISPLAY_DETAILS_STATIONS = .false.

! maximum length of station and network name for receivers
  integer, parameter :: MAX_LENGTH_STATION_NAME = 32
  integer, parameter :: MAX_LENGTH_NETWORK_NAME = 8

! we mimic a triangle of half duration equal to half_duration_triangle
! using a Gaussian having a very close shape, as explained in Figure 4.2
! of the manual. This source decay rate to mimic an equivalent triangle
! was found by trial and error
  double precision, parameter :: SOURCE_DECAY_MIMIC_TRIANGLE = 1.628d0

! maximum number of sources and receivers to locate simultaneously
  integer, parameter :: NSOURCES_SUBSET_MAX = 100
  integer, parameter :: NREC_SUBSET_MAX = 200

! use this t0 as earliest starting time rather than the automatically calculated one
! (must be positive and bigger than the automatically one to be effective;
!  simulation will start at t = - t0)
  double precision, parameter :: USER_T0 = 0.0d0

! distance threshold (in km) above which we consider that a receiver
! is located outside the mesh and therefore excluded from the station list
  double precision, parameter :: THRESHOLD_EXCLUDE_STATION = 5.d0

! This parameter flags whether or not we will use an external source
! time function. Set to false by default.
  logical, parameter :: EXTERNAL_SOURCE_TIME_FUNCTION = .false.

! This parameter determines the taper length of monochromatic source time function in seconds
  double precision, parameter :: TAPER_MONOCHROMATIC_SOURCE = 200.0d0

!!-----------------------------------------------------------
!!
!! for sponge absorbing boundary
!!
!!-----------------------------------------------------------

! decay factor at the point farthest from the boundary
  double precision, parameter :: SPONGE_MIN_Q = 30.d0

! width of the region that transits from zero attenuation to full attenuation
  double precision, parameter :: SPONGE_WIDTH_IN_DEGREES = 15.d0

!!-----------------------------------------------------------
!!
!! for attenuation
!!
!!-----------------------------------------------------------
! note: We compute a constant Q behavior over a frequency absorption-band using a series of standard linear solids (SLS).
!       The absorption-band limits are determined by the maximum frequency (or minimum period) resolved by the mesh.
!       We shift the velocities to the logarithmic center frequency of this simulation frequency absorption-band,
!       accounting for physical dispersion effects of the Q model, assuming that the provided velocity model values
!       refer to a reference frequency f0 specified below.

! reference frequency of anelastic model
! by default, we use PREM values at 1 Hz
  double precision, parameter :: ATTENUATION_f0_REFERENCE = 1.d0   ! in Hz

! saves velocity model files shifted to the center frequency of the simulation attenuation period band
  logical, parameter :: ATTENUATION_SAVE_MODEL_AT_SHIFTED_CENTER_FREQ = .false.

! in the case of 1D attenuation models, use NGLL^3 storage of the attenuation constants in each GLL spectral element anyway
! (always safe to leave that to true; in the case of 1D attenuation models, setting it to false can save some memory storage)
  logical, parameter :: ATTENUATION_1D_WITH_3D_STORAGE  = .true.

!!-----------------------------------------------------------
!!
!! noise simulations
!!
!!-----------------------------------------------------------

! noise buffer for file i/o
! maximum noise buffer size in MB (will be used to evaluate number of steps for buffer, when UNDO_ATTENUATION == .false.)
! good performance results obtained for buffer sizes ~ 150 MB
  double precision,parameter :: MAXIMUM_NOISE_BUFFER_SIZE_IN_MB = 150.d0


!!-----------------------------------------------------------
!!
!! mesh optimization
!!
!!-----------------------------------------------------------

! maximum number of chunks (full sphere)
  integer, parameter :: NCHUNKS_MAX = 6

! Courant number for time step suggestion
! (empirical choice for distorted elements to estimate time step)
  double precision,parameter :: COURANT_SUGGESTED = 0.55d0

! number of points per minimum wavelength for minimum period estimate
  integer,parameter :: NPTS_PER_WAVELENGTH = 5

! the first doubling is implemented right below the Moho
! it seems optimal to implement the three other doublings at these depths
! in the mantle
  double precision, parameter :: EARTH_DEPTH_SECOND_DOUBLING_OPTIMAL = 1650000.d0
! in the outer core
  double precision, parameter :: EARTH_DEPTH_THIRD_DOUBLING_OPTIMAL  = 3860000.d0
! in the outer core
  double precision, parameter :: EARTH_DEPTH_FOURTH_DOUBLING_OPTIMAL = 5000000.d0

! to suppress element stretching for 3D moho surface
  logical,parameter :: SUPPRESS_MOHO_STRETCHING = .false.

! to suppress element stretching at 410/660 internal topography
! (i.e. creates mesh without 410/660 topography for Harvard model (s362ani,..))
  logical,parameter :: SUPPRESS_INTERNAL_TOPOGRAPHY = .false.

! by default, SAVE_MESH_FILES will use VTK formats; this will also output additional AVS_DX format files
  logical,parameter :: SAVE_MESHFILES_AVS_DX_FORMAT = .false.

!!-----------------------------------------------------------
!!
!! GPU optimization
!!
!!-----------------------------------------------------------
! added these parameters for the GPU version of the solver

! asynchronuous memcopy between CPU and GPU
  logical, parameter :: GPU_ASYNC_COPY = .true.

! mesh coloring
! add mesh coloring for the GPU + MPI implementation
! this is needed on NVIDIA hardware up to FERMI boards, included.
! Starting on KEPLER boards you can leave it off because on KEPLER hardware
! or higher atomic reduction operations have become as fast as resorting to mesh coloring.
  logical, parameter :: USE_MESH_COLORING_GPU = .false.
  integer, parameter :: MAX_NUMBER_OF_COLORS = 1000
! enhanced coloring:
! using Droux algorithm
! try several times with one more color before giving up
  logical, parameter :: USE_DROUX_OPTIMIZATION = .false.
  integer, parameter :: MAX_NB_TRIES_OF_DROUX_1993 = 15
! using balancing algorithm
! postprocess the colors to balance them if Droux (1993) algorithm is not used
  logical, parameter :: BALANCE_COLORS_SIMPLE_ALGO = .true.


!!-----------------------------------------------------------
!!
!! ADIOS Related values
!!
!!-----------------------------------------------------------

! for undo_att snapshots
! use only one file for all steps or a single file per iteration step
  logical, parameter :: ADIOS_SAVE_ALL_SNAPSHOTS_IN_ONE_FILE = .true.

! type selection to use compression operation before saving undo_att forward snapshot arrays
! compression algorithm: 0 == none / 1 == ZFP compression / 2 == SZ compression (needs to be supported by ADIOS2 library)
  integer, parameter :: ADIOS_COMPRESSION_ALGORITHM = 0     ! (default none)

!! ZFP compression
! mode options: see https://zfp.readthedocs.io/en/release0.5.5/modes.html
! parameters: 'rate'      w/ value '8'    - fixed-rate mode: choose values between ~8-20, higher for better accuracy
!             'accuracy'  w/ value '0.01' - fixed-accuracy mode: choose smaller value for better accuracy
!             'precision' w/ value '10'   - fixed-precision mode: choose between ~10-50, higher for better accuracy
!                                           (https://www.osti.gov/pages/servlets/purl/1572236)
!
! test setup: global simulation (s362ani model), NEX=160, ADIOS 2.5.0
!             duration 30 min, 9 snapshot files (w/ estimated total size 117.6 GB)
! - {'rate','8'} leads to a rather constant compression by using (8+1)-bit representation for 4 32-bit floats
!     compression rate factor: ~3.98x (123474736 Bytes / 30998320 Bytes ~ 118 GB / 30GB)
!                              betav_kl_crust_mantle total norm of difference :   2.6486799E-22
! - {'rate','12'} has better accuracy (leading to small wavefield perturbations)
!     compression rate factor: ~2.65x (123474736 Bytes / 46423124 Bytes ~ 118 GB / 45GB)
!                              betav_kl_crust_mantle total norm of difference :   4.3890730E-24
! - {'precision','10'} leads to a more variable compression for wavefields depending on their dynamic range
!     compression rate factor: ~4.05x (123474736 Bytes / 30460388 Bytes ~ 118 GB / 30 GB)
!                              betav_kl_crust_mantle total norm of difference :   5.3706092E-24
! - {'precision','12'} has better accuracy (leading to small wavefield perturbations)
!     compression rate factor: ~3.43x (123474736 Bytes / 35972672 Bytes ~ 118 GB / 35GB)
!                              betav_kl_crust_mantle total norm of difference :   1.9846376E-25
! - {'precision','20'} has good accuracy (almost identical reconstructed waveforms)
!     compression rate factor: ~2.12x (123474736 Bytes / 58020080 Bytes ~ 118 GB / 56 GB)
!                              betav_kl_crust_mantle total norm of difference :   2.5939579E-30
!
! performance overhead for compressing/decompressing is negligible in all cases
! (a few seconds, compared to minutes for the total simulaton)
!
! a default setting of {'precision','12'} seems a good compromise between accuracy and compression rate
  character(len=*), parameter :: ADIOS_COMPRESSION_MODE = 'precision'     ! 'precision','rate'
  character(len=*), parameter :: ADIOS_COMPRESSION_MODE_VALUE = '12'      ! '8','12,'20'

!! SZ compression
! parameters: 'accuracy', value '0.0000000001' = 1.e-10
!             leaving empty '','' chooses automatic setting? to check...
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE = ''
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE_VALUE = ''

!! LZ4 compression (lossless)
! parameters: level 'lvl=9' and 'threshold=4096' 4K-bytes
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE = 'lvl'
  !character(len=*), parameter :: ADIOS_COMPRESSION_MODE_VALUE = '9,threshold=4096'

! size of the ADIOS buffer to use
  integer, parameter :: ADIOS_BUFFER_SIZE_IN_MB = 400

! ADIOS transport methods (see ADIOS manual for details)
!! MPI (default)
  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD = "MPI"
  character(len=*), parameter :: ADIOS_METHOD_PARAMS =  ''

! ADIOS transport methods for undo save_frame** data files
!! MPI (default)
  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "MPI"
  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  ''
! or
!! POSIX
!  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "POSIX"
!  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  ''
! or
!! MPI_AGGREGATE
!  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "MPI_AGGREGATE"
!  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  "num_aggregators=64,num_ost=672"
! or
!! MPI_LUSTRE
!  character(len=*), parameter :: ADIOS_TRANSPORT_METHOD_UNDO_ATT = "MPI_LUSTRE"
!  character(len=*), parameter :: ADIOS_METHOD_PARAMS_UNDO_ATT =  "stripe_count=16,stripe_size=4194304,block_size=4194304"

!!-----------------------------------------------------------
!!
!! ADIOS2 Related values
!!
!!-----------------------------------------------------------

! ADIOS2 engines
!! note on native engine types:
!!  - "MPI" is not supported yet by adios2 version (current 2.6.0), check out in future.
!!  - "HDF5" doesn't support file appending yet, which is needed at the moment.
!!  - "BPfile" doesn't support file appending yet, which is needed at the moment.
!!  - "BP3" would allow for backward compatibility to ADIOS 1.x, but doesn't support file appending yet.
!!  - "BP4" is the new adios2 format with enhanced capabilities.
!! we will use "BP4" by default.
!!
!! BP4
!! format details: https://adios2.readthedocs.io/en/latest/engines/engines.html#bp4
!!
!! note: parameter SubStreams=64 for larger runs with NPROCS > 64 creates problems when reading scalar values (in appended mode),
!!       try to avoid it for now as default parameter.
!!       for undo_att, it seems to work however and can be used in ADIOS2_ENGINE_PARAMS_UNDO_ATT setting.
!!
!!       in future adios2 versions, re-evalute if parameters could be "SubStreams=64,MaxBufferSize=800Mb" for larger runs
  character(len=*), parameter :: ADIOS2_ENGINE_DEFAULT = "BP4"
  character(len=*), parameter :: ADIOS2_ENGINE_PARAMS_DEFAULT = "" ! add "MaxBufferSize=800Mb" for larger runs

  character(len=*), parameter :: ADIOS2_ENGINE_UNDO_ATT = "BP4"
  character(len=*), parameter :: ADIOS2_ENGINE_PARAMS_UNDO_ATT = "" ! add "SubStreams=64,MaxBufferSize=800Mb" for larger runs


!!-----------------------------------------------------------
!!
!! ASDF parameters
!!
!!-----------------------------------------------------------

! keeps track of everything
! stores specfem provenance string in ASDF file
  logical, parameter :: ASDF_OUTPUT_PROVENANCE = .false.

! ASDF string lengths
  integer, parameter :: ASDF_MAX_STRING_LENGTH = 1024
  integer, parameter :: ASDF_MAX_QUAKEML_LENGTH = 8096
  integer, parameter :: ASDF_MAX_STATIONXML_LENGTH = 16182
  integer, parameter :: ASDF_MAX_PARFILE_LENGTH = 25000
  integer, parameter :: ASDF_MAX_CONSTANTS_LENGTH = 65000
  integer, parameter :: ASDF_MAX_TIME_STRING_LENGTH = 22


!!-----------------------------------------------------------
!!
!! adjoint kernel outputs
!!
!!-----------------------------------------------------------

! asynchronuous reading of adjoint sources
  logical, parameter :: IO_ASYNC_COPY = .true.

! regular kernel parameters
  character(len=*), parameter :: PATHNAME_KL_REG = 'DATA/kl_reg_grid.txt'
  integer, parameter :: NM_KL_REG_LAYER = 100
  integer, parameter :: NM_KL_REG_PTS = 300000
  real, parameter :: KL_REG_MIN_LON = 0.0
  real, parameter :: KL_REG_MAX_LON = 360.0
  real, parameter :: KL_REG_MIN_LAT = -90.0
  real, parameter :: KL_REG_MAX_LAT = +90.0

! by default, we turn kernel computations in the outer and inner core and for topology kernels off
!
! kernels for outer core
  logical, parameter :: SAVE_KERNELS_OC = .false.

! kernels for inner core
  logical, parameter :: SAVE_KERNELS_IC = .false.

! kernels for MOHO, 400, 670, CMB and ICB discontinuities
  logical, parameter :: SAVE_KERNELS_BOUNDARY = .false.

! Boundary Mesh -- save Moho, 400, 670 km discontinuity topology files (in
! the mesher) and use them for the computation of boundary kernel (in the solver)
  logical, parameter :: SAVE_BOUNDARY_MESH = SAVE_KERNELS_BOUNDARY

! flag to write seismograms with adjoint wavefield instead of backward, reconstructed wavefield
  logical, parameter :: OUTPUT_ADJOINT_WAVEFIELD_SEISMOGRAMS = .false.

! flag to use source-receicer preconditioner instead of source-source preconditioner
  logical, parameter :: USE_SOURCE_RECEIVER_Hessian = .true.

! number of timesteps between calling compute_kernels() in adjoint simulation with undo_attenuation
! note: this flag is tested for stationary kernels only (STEADY_STATE_KERNEL = .true.)
! be careful when changing this flag when computing classical kernel
  integer, parameter :: NTSTEP_BETWEEN_COMPUTE_KERNELS = 1


!!-----------------------------------------------------------
!!
!! time stamp information
!!
!!-----------------------------------------------------------

! print date and time estimate of end of run in another country,
! in addition to local time.
! For instance: the code runs at Caltech in California but the person
! running the code is connected remotely from France, which has 9 hours more.
! The time difference with that remote location can be positive or negative
  logical, parameter :: ADD_TIME_ESTIMATE_ELSEWHERE = .false.
  integer, parameter :: HOURS_TIME_DIFFERENCE = +9
  integer, parameter :: MINUTES_TIME_DIFFERENCE = +0


!!-----------------------------------------------------------
!!
!! directory structure
!!
!!-----------------------------------------------------------

! paths for inputs and outputs files
  character(len=*), parameter :: OUTPUT_FILES_BASE = './OUTPUT_FILES/'


!!-----------------------------------------------------------
!!
!! movie outputs
!!
!!-----------------------------------------------------------

! runs external bash script after storing movie files
! (useful for postprocessing during simulation time)
  logical, parameter :: RUN_EXTERNAL_MOVIE_SCRIPT = .false.
  character(len=*),parameter :: MOVIE_SCRIPT_NAME = "./tar_movie_files.sh"

!!-----------------------------------------------------------
!!
!! smoothing of the sensitivity kernels
!!
!!-----------------------------------------------------------

! using this is more precise, but more costly
  logical, parameter :: USE_QUADRATURE_RULE_FOR_SMOOTHING = .true.

! using Euclidian vector distance to calculate vertical and horizontal distances between two points,
! which is faster than using the exact epicentral distance for the horizontal distance.
  logical, parameter :: USE_VECTOR_DISTANCE_FOR_SMOOTHING = .true.


!!-----------------------------------------------------------
!!
!! for gravity integrals
!!
!!-----------------------------------------------------------
! (for using gravity integral computations, please make sure you compile with double-precision --enable-double-precision)

  logical, parameter :: GRAVITY_INTEGRALS = .false.

! reuse an existing observation surface created in another run and stored to disk,
! so that we are sure that they are exactly the same (for instance when comparing results for a reference ellipsoidal Earth
! and results for a 3D Earth with topography)
  logical, parameter :: REUSE_EXISTING_OBSERVATION_SURF = .false.

! only compute the center of mass of the 3D model (very cheap), or also compute the gravity integrals (expensive)
  logical, parameter :: ONLY_COMPUTE_CENTER_OF_MASS = .false.

! we may want to shift the reference frame to a pre-computed center of mass
  logical, parameter :: SHIFT_TO_THIS_CENTER_OF_MASS = .true.

! position of the center of mass of the Earth for this density model and mesh,
! but first convert it to meters and then make it non-dimensional
  double precision, parameter :: x_shift =   0.606220633681674d0 * 1000.d0 / EARTH_R !    km
  double precision, parameter :: y_shift =   0.433103991863316d0 * 1000.d0 / EARTH_R !    km
  double precision, parameter :: z_shift =   0.520078637496872d0 * 1000.d0 / EARTH_R !    km
!    distance to center =   0.908605697566306       km

! altitude of the observation points in km
  double precision, parameter :: altitude_of_observation_points = 255.d0

! elevation ratio of the points at which we observe
  double precision, parameter :: observation_elevation_ratio = (EARTH_R_KM + altitude_of_observation_points) / EARTH_R_KM

! compute the contribution of the crust only (otherwise by default compute the contribution of the whole Earth)
  logical, parameter :: COMPUTE_CRUST_CONTRIB_ONLY = .false.

! check for negative Jacobians in the calculation of integrals or not
! (can safely be done once to check that the mesh is OK at a given resolution, and then permanently
!  turned off in future runs because the mesh does not change)
  logical, parameter :: CHECK_FOR_NEGATIVE_JACOBIANS = .true.

! number of points in each horizontal direction of the observation grid of each cubed-sphere chunk
! at the altitude of the observation point
!! 4 is a fictitious value used to save memory when the GRAVITY_INTEGRALS option is off
  integer, parameter :: NX_OBSERVATION = 4 ! 500
  integer, parameter :: NY_OBSERVATION = NX_OBSERVATION

! the code will display sample output values at this particular point as a check
  integer, parameter :: ixr = max(int(NX_OBSERVATION / 3.0), 1)
  integer, parameter :: iyr = max(int(NY_OBSERVATION / 4.0), 1)
  integer, parameter :: ichunkr = 3

! how often (every how many spectral elements computed) we print a timestamp to monitor the behavior of the code
  integer, parameter :: NSPEC_DISPLAY_INTERVAL = 100


!!-----------------------------------------------------------
!!
!! debugging flags
!!
!!-----------------------------------------------------------

! flag to turn on ordered assembly, where the the order of the summation depends on the order of MPI ranks.
! used for testing
  logical, parameter :: DO_ORDERED_ASSEMBLY = .false.

! flags to actually assemble with MPI or not
! and to actually match fluid and solid regions of the Earth or not
! should always be set to true except when debugging code
  logical, parameter :: ACTUALLY_ASSEMBLE_MPI_SLICES = .true.
  logical, parameter :: ACTUALLY_ASSEMBLE_MPI_CHUNKS = .true.
  logical, parameter :: ACTUALLY_COUPLE_FLUID_CMB = .true.
  logical, parameter :: ACTUALLY_COUPLE_FLUID_ICB = .true.

! flag to turn off the conversion of geographic to geocentric coordinates for
! the seismic source and the stations; i.e. assume a perfect sphere, which
! can be useful for benchmarks of a spherical Earth with fictitious sources and stations
  logical, parameter :: ASSUME_PERFECT_SPHERE = .false.

! flags to do benchmark runs to measure scaling of the code
! for a limited number of time steps only, setting the initial field to 1
! to make sure gradual underflow trapping does not slow down the code
  logical, parameter :: DO_BENCHMARK_RUN_ONLY = .false.
  integer, parameter :: NSTEP_FOR_BENCHMARK = 300
  logical, parameter :: SET_INITIAL_FIELD_TO_1_IN_BENCH = .true.

! for validation of undoing of attenuation versus an exact solution saved to disk
! should never be needed any more, it was developed and used for Figure 3 of
! D. Komatitsch, Z. Xie, E. Bozdag, E. Sales de Andrade, D. Peter, Q. Liu and J. Tromp,
! Anelastic sensitivity kernels with parsimonious storage for adjoint tomography and full waveform inversion,
! Geophysical Journal International, vol. 206(3), p. 1467-1478, doi: 10.1093/gji/ggw224 (2016).
!
! Compute an alpha sensitivity kernel directly by dumping the whole forward
! run to disk instead of rebuilding it backwards from the final time step in a second stage;
! used for debugging and validation purposes only, in order to have an exact reference for the sensitivity kernels.
! use wisely, this requires several terabytes (yes, tera) of disk space.
! In the future that option should become standard at some point though.
! For now, in order to save disk space, it is implemented for the alpha kernel only
! (because it only requires saving a scalar: the trace of epsilon) and for surface wave
! kernels only, this way we can save the upper mantle only and ignore the rest.
! In the future it will be easy to generalize this though.
  logical, parameter :: EXACT_UNDOING_TO_DISK = .false.
  ! ID of the huge file in which we dump all the time steps of the simulation
  integer, parameter :: IFILE_FOR_EXACT_UNDOING = 244
  ! Number of time steps between dumping the forward run
  integer, parameter :: NSTEP_FOR_EXACT_UNDOING = 500

!------------------------------------------------------
!----------- do not modify anything below -------------
!------------------------------------------------------

! on some processors (e.g. some Intel chips) it is necessary to suppress underflows
! by using a small initial field instead of zero
!! August 2018: on modern processors this does not happen any more,
!! August 2018: and thus no need to purposely lose accuracy to avoid underflows; thus turning it off by default
  logical, parameter :: FIX_UNDERFLOW_PROBLEM = .false. ! .true.

! some useful constants
  double precision, parameter :: PI = 3.141592653589793d0
  double precision, parameter :: TWO_PI = 2.d0 * PI
  double precision, parameter :: PI_OVER_FOUR = PI / 4.d0
  double precision, parameter :: PI_OVER_TWO = PI / 2.0d0

! to convert angles from degrees to radians
  double precision, parameter :: DEGREES_TO_RADIANS = PI / 180.d0
! to convert angles from radians to degrees
  double precision, parameter :: RADIANS_TO_DEGREES = 180.d0 / PI

! 3-D simulation
  integer, parameter :: NDIM = 3

! dimension of the boundaries of the slices
  integer, parameter :: NDIM2D = 2

! number of nodes for 2D and 3D shape functions for hexahedra with 27 nodes
  integer, parameter :: NGNOD = 27, NGNOD2D = 9

! assumes NGLLX == NGLLY == NGLLZ
  integer, parameter :: NGLLSQUARE = NGLLX * NGLLY

! Deville routines optimized for NGLLX = NGLLY = NGLLZ = 5
  integer, parameter :: m1 = NGLLX, m2 = NGLLX * NGLLY
  integer, parameter :: NGLLCUBE = NGLLX * NGLLY * NGLLZ

! mid-points inside a GLL element
  integer, parameter :: MIDX = (NGLLX+1)/2
  integer, parameter :: MIDY = (NGLLY+1)/2
  integer, parameter :: MIDZ = (NGLLZ+1)/2

! gravitational constant in S.I. units i.e. in m3 kg-1 s-2, or equivalently in N.(m/kg)^2
!! April 2014: switched to the 2010 Committee on Data for Science and Technology (CODATA) recommended value
!! see e.g. http://www.physics.nist.gov/cgi-bin/cuu/Value?bg
!! and http://en.wikipedia.org/wiki/Gravitational_constant
!! double precision, parameter :: GRAV = 6.6723d-11
!! double precision, parameter :: GRAV = 6.67430d-11  ! newer suggestion by CODATA 2018
  double precision, parameter :: GRAV = 6.67384d-11  ! CODATA 2010

! standard gravity at the surface of the Earth
  double precision, parameter :: EARTH_STANDARD_GRAVITY = 9.80665d0 ! in m.s-2

! a few useful constants
  double precision, parameter :: ZERO = 0.d0,ONE = 1.d0,TWO = 2.d0,HALF = 0.5d0
  double precision, parameter :: ONE_HALF = HALF, ONE_FOURTH = 0.25d0, ONE_EIGHTH = 0.125d0, ONE_SIXTEENTH = 0.0625d0

  real(kind=CUSTOM_REAL), parameter :: &
    ONE_THIRD   = 1._CUSTOM_REAL/3._CUSTOM_REAL, &
    TWO_THIRDS  = 2._CUSTOM_REAL/3._CUSTOM_REAL, &
    FOUR_THIRDS = 4._CUSTOM_REAL/3._CUSTOM_REAL

! very large and very small values
  double precision, parameter :: HUGEVAL = 1.d+30,TINYVAL = 1.d-9

! very large real value declared independently of the machine
  real(kind=CUSTOM_REAL), parameter :: HUGEVAL_SNGL = 1.e+30_CUSTOM_REAL

! very large integer value
  integer, parameter :: HUGEINT = 100000000

! normalized radius of free surface
  double precision, parameter :: R_UNIT_SPHERE = ONE

! fixed thickness of 3 km for PREM oceans
  double precision, parameter :: THICKNESS_OCEANS_PREM = 3000.d0 / EARTH_R

! shortest radius at which crust is implemented (80 km depth)
! to be constistent with the D80 discontinuity, we impose the crust only above it
  double precision, parameter :: EARTH_R_DEEPEST_CRUST = (EARTH_R - 80000.d0) / EARTH_R

! definition of an Eotvos compared to S.I. units.
! The unit of gravity gradient is the Eotvos, which is equivalent to 1e-9 s-2 (or 1e-4 mGal/m).
! A person walking at a distance of 2 meters provides a gravity gradient signal of approximately one Eotvos.
! Mountains can create signals of several hundred Eotvos.
  double precision, parameter :: SI_UNITS_TO_EOTVOS = 1.d+9

! define block type based upon chunk number (between 1 and 6)
! do not change this numbering, chunk AB must be number 1 for central cube
  integer, parameter :: CHUNK_AB = 1
  integer, parameter :: CHUNK_AC = 2
  integer, parameter :: CHUNK_BC = 3
  integer, parameter :: CHUNK_AC_ANTIPODE = 4
  integer, parameter :: CHUNK_BC_ANTIPODE = 5
  integer, parameter :: CHUNK_AB_ANTIPODE = 6

! maximum number of regions in the mesh
  integer, parameter :: MAX_NUM_REGIONS = 5    ! (CRUST_MANTLE, OUTER_CORE, INNER_CORE) + (TRINFINITE, INFINITE) regions

! define flag for planet
! strictly speaking, the moon is not a planet but a natural satellite. well, let's stay with IPLANET_** for now.
  integer, parameter :: IPLANET_EARTH = 1
  integer, parameter :: IPLANET_MARS = 2
  integer, parameter :: IPLANET_MOON = 3

! define flag for regions of the global Earth mesh
  integer, parameter :: IREGION_CRUST_MANTLE = 1
  integer, parameter :: IREGION_OUTER_CORE = 2
  integer, parameter :: IREGION_INNER_CORE = 3

! define flag for region of the infinite-element mesh surrounding the global mesh
  integer, parameter :: IREGION_TRINFINITE = 4      ! transition-to-infinite region
  integer, parameter :: IREGION_INFINITE = 5        ! infinite mesh region

! define flag for elements
  integer, parameter :: IFLAG_CRUST = 1

  integer, parameter :: IFLAG_80_MOHO = 2
  integer, parameter :: IFLAG_220_80 = 3
  integer, parameter :: IFLAG_670_220 = 4
  integer, parameter :: IFLAG_MANTLE_NORMAL = 5

  integer, parameter :: IFLAG_OUTER_CORE_NORMAL = 6

  integer, parameter :: IFLAG_INNER_CORE_NORMAL = 7
  integer, parameter :: IFLAG_MIDDLE_CENTRAL_CUBE = 8
  integer, parameter :: IFLAG_BOTTOM_CENTRAL_CUBE = 9
  integer, parameter :: IFLAG_TOP_CENTRAL_CUBE = 10
  integer, parameter :: IFLAG_IN_FICTITIOUS_CUBE = 11

  integer, parameter :: NSPEC2D_XI_SUPERBRICK = 8
  integer, parameter :: NSPEC2D_ETA_SUPERBRICK = 8
  integer, parameter :: NSPEC2D_XI_SUPERBRICK_1L = 6
  integer, parameter :: NSPEC2D_ETA_SUPERBRICK_1L = 6

! dummy flag used for mesh display purposes only
  integer, parameter :: IFLAG_DUMMY = 100

! max number of layers that are used in the radial direction to build the full mesh
  integer, parameter :: MAX_NUMBER_OF_MESH_LAYERS = 15

! define number of spectral elements and points in basic symmetric mesh doubling superbrick
  integer, parameter :: NSPEC_DOUBLING_SUPERBRICK = 32
  integer, parameter :: NGLOB_DOUBLING_SUPERBRICK = 67
  integer, parameter :: NSPEC_SUPERBRICK_1L = 28
  integer, parameter :: NGLOB_SUPERBRICK_1L = 58
  integer, parameter :: NGNOD_EIGHT_CORNERS = 8

! define flag for reference 1D Earth model
  integer, parameter :: REFERENCE_MODEL_PREM       = 1
  integer, parameter :: REFERENCE_MODEL_PREM2      = 2
  integer, parameter :: REFERENCE_MODEL_IASP91     = 3
  integer, parameter :: REFERENCE_MODEL_1066A      = 4
  integer, parameter :: REFERENCE_MODEL_AK135F_NO_MUD = 5
  integer, parameter :: REFERENCE_MODEL_1DREF      = 6
  integer, parameter :: REFERENCE_MODEL_JP1D       = 7
  integer, parameter :: REFERENCE_MODEL_SEA1D      = 8
  integer, parameter :: REFERENCE_MODEL_CCREM      = 9
  integer, parameter :: REFERENCE_MODEL_SEMUCB     = 10   ! Berkeley reference model
  ! Mars
  integer, parameter :: REFERENCE_MODEL_SOHL       = 101
  integer, parameter :: REFERENCE_MODEL_SOHL_B     = 102
  integer, parameter :: REFERENCE_MODEL_CASE65TAY  = 103
  integer, parameter :: REFERENCE_MODEL_MARS_1D    = 104  ! defined by file

  ! Moon
  integer, parameter :: REFERENCE_MODEL_VPREMOON   = 201
  integer, parameter :: REFERENCE_MODEL_MOON_MEENA = 202

! crustal model constants
  integer, parameter :: ICRUST_CRUST1      = 1    ! Crust1.0
  integer, parameter :: ICRUST_CRUST2      = 2    ! Crust2.0
  integer, parameter :: ICRUST_CRUSTMAPS   = 3    ! Crustmaps
  integer, parameter :: ICRUST_EPCRUST     = 4    ! EPcrust
  integer, parameter :: ICRUST_CRUST_SH    = 5    ! Spherical-Harmonics Crust
  integer, parameter :: ICRUST_EUCRUST     = 6    ! EUcrust07
  integer, parameter :: ICRUST_SGLOBECRUST = 7    ! modified Crust2.0 for SGLOBE-rani
  integer, parameter :: ICRUST_BKMNS_GLAD  = 8    ! Block Mantle Spherical-Harmonics model
  integer, parameter :: ICRUST_SPIRAL      = 9    ! SPiRaL
  integer, parameter :: ICRUST_SH_MARS     = 10   ! SH mars models (define crust & mantle values)
  integer, parameter :: ICRUST_BERKELEY    = 11   ! Berkeley crustal model

! define flag for 3D Earth model
  integer, parameter :: THREE_D_MODEL_S20RTS        = 101
  integer, parameter :: THREE_D_MODEL_S362ANI       = 102
  integer, parameter :: THREE_D_MODEL_S362WMANI     = 103
  integer, parameter :: THREE_D_MODEL_S362ANI_PREM  = 104
  integer, parameter :: THREE_D_MODEL_S29EA         = 105
  integer, parameter :: THREE_D_MODEL_SEA99_JP3D    = 106
  integer, parameter :: THREE_D_MODEL_SEA99         = 107
  integer, parameter :: THREE_D_MODEL_JP3D          = 108
  integer, parameter :: THREE_D_MODEL_PPM           = 109            ! format for point profile models
  integer, parameter :: THREE_D_MODEL_GLL           = 110            ! format for iterations with GLL mesh
  integer, parameter :: THREE_D_MODEL_S40RTS        = 111
  integer, parameter :: THREE_D_MODEL_GAPP2         = 112
  integer, parameter :: THREE_D_MODEL_MANTLE_SH     = 113
  integer, parameter :: THREE_D_MODEL_SGLOBE        = 114
  integer, parameter :: THREE_D_MODEL_SGLOBE_ISO    = 115
  integer, parameter :: THREE_D_MODEL_ANISO_MANTLE  = 116
  integer, parameter :: THREE_D_MODEL_BKMNS_GLAD    = 117
  integer, parameter :: THREE_D_MODEL_SPIRAL        = 118
  integer, parameter :: THREE_D_MODEL_HETEROGEN_PREM = 119
  integer, parameter :: THREE_D_MODEL_SH_MARS       = 120
  integer, parameter :: THREE_D_MODEL_BERKELEY      = 121
  ! inner core model
  integer, parameter :: THREE_D_MODEL_INNER_CORE_ISHII = 201

!! attenuation
! number of standard linear solids for attenuation
  integer, parameter :: N_SLS = 3

! computation of standard linear solids in meshfem3D
! ATTENUATION_COMP_RESOLUTION: Number of Digits after decimal
! ATTENUATION_COMP_MAXIMUM:    Maximum Q Value
  integer, parameter :: ATTENUATION_COMP_RESOLUTION = 1
  integer, parameter :: ATTENUATION_COMP_MAXIMUM    = 9000

! for determination of the attenuation period range
! if this is set to .true. then the hardcoded values will be used
! otherwise they are computed automatically from the Number of elements
! This *may* be a useful parameter for Benchmarking against older versions
  logical, parameter :: ATTENUATION_RANGE_PREDEFINED = .false.

! flag for the four edges of each slice and for the bottom edge
  integer, parameter :: XI_MIN  = 1
  integer, parameter :: XI_MAX  = 2
  integer, parameter :: ETA_MIN = 3
  integer, parameter :: ETA_MAX = 4
  integer, parameter :: BOTTOM  = 5

! flags to select the right corner in each slice
  integer, parameter :: ILOWERLOWER = 1
  integer, parameter :: ILOWERUPPER = 2
  integer, parameter :: IUPPERLOWER = 3
  integer, parameter :: IUPPERUPPER = 4

! number of points in each AVS or OpenDX quadrangular cell for movies
  integer, parameter :: NGNOD2D_AVS_DX = 4

! number of faces a given slice can share with other slices
! this is at most 2, except when there is only once slice per chunk
! in which case it is 4
  integer, parameter :: NUMFACES_SHARED = 4

! number of corners a given slice can share with other slices
! this is at most 1, except when there is only once slice per chunk
! in which case it is 4
  integer, parameter :: NUMCORNERS_SHARED = 4

! number of layers in PREM
  integer, parameter :: NR_DENSITY = 640

! smallest real number on many machines =  1.1754944E-38
! largest real number on many machines =  3.4028235E+38
! small negligible initial value to avoid very slow underflow trapping
! but not too small to avoid trapping on velocity and acceleration in Newmark
  real(kind=CUSTOM_REAL), parameter :: VERYSMALLVAL = 1.E-24_CUSTOM_REAL

! displacement threshold above which we consider that the code became unstable
  real(kind=CUSTOM_REAL), parameter :: STABILITY_THRESHOLD = 1.E+25_CUSTOM_REAL

! geometrical tolerance for boundary detection
  double precision, parameter :: SMALLVAL = 0.00001d0

! small tolerance for conversion from x y z to r theta phi
  double precision, parameter :: SMALL_VAL_ANGLE = 1.d-10

! geometry tolerance parameter to calculate number of independent grid points
! sensitive to actual size of model, assumes reference sphere of radius 1
! this is an absolute value for normalized coordinates in the Earth
  double precision, parameter :: SMALLVALTOL = 1.d-10

! do not use tags for MPI messages, use dummy tag instead
  integer, parameter :: itag = 0,itag2 = 0

! for the Gauss-Lobatto-Legendre points and weights
  double precision, parameter :: GAUSSALPHA = 0.d0,GAUSSBETA = 0.d0

! number of lines per source in CMTSOLUTION file
  integer, parameter :: NLINES_PER_CMTSOLUTION_SOURCE = 13
  integer, parameter :: NLINES_PER_FORCESOLUTION_SOURCE = 11

! number of iterations to solve the system for xi and eta
! setting it to 5 instead of 4 ensures that the result obtained is not compiler dependent
! (when using 4 only some small discrepancies were observed)
  integer, parameter :: NUM_ITER = 5

! number of hours per day for rotation rate of the Earth
  double precision, parameter :: EARTH_HOURS_PER_DAY = 24.d0
  double precision, parameter :: EARTH_SECONDS_PER_HOUR = 3600.d0

! for lookup table for gravity every 100 m in radial direction of Earth model
  integer, parameter :: NRAD_GRAVITY = 70000


!!-----------------------------------------------------------
!!
!! GLL model constants
!!
!!-----------------------------------------------------------

! parameters for GLL model (used for iterative model inversions)
  character(len=*), parameter :: PATHNAME_GLL_modeldir = 'DATA/GLL/'

! to create a reference model based on the 1D reference model but with 3D crust and 410/660 topography
  logical,parameter :: USE_1D_REFERENCE = .false.

!!-- uncomment for using PREM as reference model (used in CEM inversion)
!  integer, parameter :: GLL_REFERENCE_1D_MODEL = REFERENCE_MODEL_PREM
!  integer, parameter :: GLL_REFERENCE_MODEL = REFERENCE_MODEL_PREM

!!-- uncomment for using S362ANI as reference model
  integer, parameter :: GLL_REFERENCE_1D_MODEL = REFERENCE_MODEL_1DREF
  integer, parameter :: GLL_REFERENCE_MODEL = THREE_D_MODEL_S362ANI

!!-- uncomment for using S29EA as reference model
!  integer, parameter :: GLL_REFERENCE_1D_MODEL = REFERENCE_MODEL_1DREF
!  integer, parameter :: GLL_REFERENCE_MODEL = THREE_D_MODEL_S29EA

!!-----------------------------------------------------------
!!
!! crustal stretching
!!
!!-----------------------------------------------------------

! for the stretching of crustal elements in the case of 3D models
! (values are chosen for 3D models to have RMOHO_FICTITIOUS at 35 km
!  and RMIDDLE_CRUST to become 15 km with stretching function stretch_tab)
  double precision, parameter :: EARTH_MAX_RATIO_CRUST_STRETCHING = 0.75d0
  double precision, parameter :: EARTH_RMOHO_STRETCH_ADJUSTMENT = 5000.d0 ! moho up to 35km
  double precision, parameter :: EARTH_R80_STRETCH_ADJUSTMENT = -40000.d0 ! r80 down to 120km

! adapted regional moho stretching
! 1 chunk simulations, 3-layer crust
  logical, parameter :: EARTH_REGIONAL_MOHO_MESH = .false.
  logical, parameter :: EARTH_REGIONAL_MOHO_MESH_EUROPE = .false. ! used only for fixing time step
  logical, parameter :: EARTH_REGIONAL_MOHO_MESH_ASIA = .false.   ! used only for fixing time step
  logical, parameter :: EARTH_HONOR_DEEP_MOHO = .false.
!!-- uncomment for e.g. Europe case, where deep moho is rare
!  double precision, parameter :: EARTH_RMOHO_STRETCH_ADJUSTMENT = -15000.d0  ! moho mesh boundary down to 55km
!!-- uncomment for deep moho cases, e.g. Asia case (Himalayan moho)
!  double precision, parameter :: EARTH_RMOHO_STRETCH_ADJUSTMENT = -20000.d0  ! moho mesh boundary down to 60km

!!-----------------------------------------------------------
!!
!! mesh tweaking
!!
!!-----------------------------------------------------------

! to suppress the crustal layers
! (replaced by an extension of the mantle: EARTH_R is not modified, but no more crustal doubling)
  logical, parameter :: SUPPRESS_CRUSTAL_MESH = .false.

! to inflate the central cube (set to 0.d0 for a non-inflated cube)
  double precision, parameter :: CENTRAL_CUBE_INFLATE_FACTOR = 0.41d0

! to add a fourth doubling at the bottom of the outer core
  logical, parameter :: ADD_4TH_DOUBLING = .false.

! parameters to cut the doubling brick

! this to cut the superbrick: 3 possibilities, 4 cases max / possibility
! three possibilities: (cut in xi and eta) or (cut in xi) or (cut in eta)
! case 1: (ximin and etamin) or ximin or etamin
! case 2: (ximin and etamax) or ximax or etamax
! case 3: ximax and etamin
! case 4: ximax and etamax
  integer, parameter :: NB_CUT_CASE = 4

! corner 1: ximin and etamin
! corner 2: ximax and etamin
! corner 3: ximax and etamax
! corner 4: ximin and etamax
  integer, parameter :: NB_SQUARE_CORNERS = 4

! two possibilities: xi or eta
! face 1: ximin or etamin
! face 2: ximax or etamax
  integer, parameter :: NB_SQUARE_EDGES_ONEDIR = 2

! this for the geometry of the basic doubling brick
  integer, parameter :: NSPEC_DOUBLING_BASICBRICK = 8
  integer, parameter :: NGLOB_DOUBLING_BASICBRICK = 27

!!-----------------------------------------------------------
!!
!! for LDDRK high-order time scheme
!!
!!-----------------------------------------------------------

! Low-dissipation and low-dispersion fourth-order Runge-Kutta algorithm
!
! reference:
! J. Berland, C. Bogey, and C. Bailly.
! Low-dissipation and low-dispersion fourth-order Runge-Kutta algorithm.
! Computers and Fluids, 35:1459-1463, 2006
!
! see: http://www.sciencedirect.com/science/article/pii/S0045793005000575?np=y

! number of stages
  integer, parameter :: NSTAGE = 6

! coefficients from Table 1, Berland et al. (2006)
  real(kind=CUSTOM_REAL), dimension(NSTAGE), parameter :: ALPHA_LDDRK = &
    (/0.0_CUSTOM_REAL,-0.737101392796_CUSTOM_REAL, -1.634740794341_CUSTOM_REAL, &
      -0.744739003780_CUSTOM_REAL,-1.469897351522_CUSTOM_REAL,-2.813971388035_CUSTOM_REAL/)

  real(kind=CUSTOM_REAL), dimension(NSTAGE), parameter :: BETA_LDDRK = &
    (/0.032918605146_CUSTOM_REAL,0.823256998200_CUSTOM_REAL,0.381530948900_CUSTOM_REAL, &
      0.200092213184_CUSTOM_REAL,1.718581042715_CUSTOM_REAL,0.27_CUSTOM_REAL/)

  real(kind=CUSTOM_REAL), dimension(NSTAGE), parameter :: C_LDDRK = &
    (/0.0_CUSTOM_REAL,0.032918605146_CUSTOM_REAL,0.249351723343_CUSTOM_REAL, &
      0.466911705055_CUSTOM_REAL,0.582030414044_CUSTOM_REAL,0.847252983783_CUSTOM_REAL/)


!!-----------------------------------------------------------
!!
!! Mars
!!
!!-----------------------------------------------------------
! Model MARS
  double precision, parameter :: MARS_R = 3390000.d0    ! default 3390.0 km radius based on Sohl models
  double precision, parameter :: R_MARS = MARS_R

! radius of the MARS in km
  double precision, parameter :: MARS_R_KM = MARS_R / 1000.d0
  double precision, parameter :: R_MARS_KM = MARS_R_KM

! average density in the full MARS to normalize equation
  double precision, parameter :: MARS_RHOAV = 3393.0d0

! Topography
!--- 4-minute model
! size of topography and bathymetry file
  integer, parameter :: MARS_NX_BATHY_4 = 5400,MARS_NY_BATHY_4 = 2700
! resolution of topography file in minutes
  double precision, parameter :: MARS_RESOLUTION_TOPO_FILE_4 = 4.0
! pathname of the topography file
  character (len=*), parameter :: MARS_PATHNAME_TOPO_FILE_4 = 'DATA/topo_bathy/topo_bathy_marstopo4_smoothed_window_3.dat.bin'
!--- Default
! Topography defaults to 4-minute
  integer, parameter :: MARS_NX_BATHY = MARS_NX_BATHY_4
  integer, parameter :: MARS_NY_BATHY = MARS_NY_BATHY_4
  double precision, parameter :: MARS_RESOLUTION_TOPO_FILE = MARS_RESOLUTION_TOPO_FILE_4
  character (len=*), parameter :: MARS_PATHNAME_TOPO_FILE = MARS_PATHNAME_TOPO_FILE_4

! Topography value min/max range
  integer, parameter :: MARS_TOPO_MINIMUM = - 8000 ! (max depth in m, Mars)
  integer, parameter :: MARS_TOPO_MAXIMUM = + 23200 ! (height in m, Olympus Mons)

! For the reference ellipsoid to convert geographic latitudes to geocentric:
! Mars flattening (https://en.wikipedia.org/wiki/Mars): 0.00589 +/- 0.00015 -> 1/f with f ~ 169.77
! Smith et al. 1999, The global topography of Mars and implications for surface evolution. Science 284(5419), 1495-1503
! uses f = 169.8
  double precision, parameter :: MARS_FLATTENING_F = 1.d0 / 169.8d0
  double precision, parameter :: MARS_ONE_MINUS_F_SQUARED = (1.d0 - MARS_FLATTENING_F)**2

! doubling layers
  double precision, parameter :: MARS_DEPTH_SECOND_DOUBLING_OPTIMAL = 1200000.d0
  double precision, parameter :: MARS_DEPTH_THIRD_DOUBLING_OPTIMAL  = 2090000.d0
  double precision, parameter :: MARS_DEPTH_FOURTH_DOUBLING_OPTIMAL = 2690000.d0

! standard gravity at the surface
  double precision, parameter :: MARS_STANDARD_GRAVITY = 3.71d0 ! in m.s-2

! shortest radius at which crust is implemented (150 km depth)
! we impose the crust only above it
  double precision, parameter :: MARS_R_DEEPEST_CRUST = (MARS_R - 150000.d0) / MARS_R

! number of hours per day for rotation rate of the planet Mars (24:39:35)
  double precision, parameter :: MARS_HOURS_PER_DAY = 24.658d0
  double precision, parameter :: MARS_SECONDS_PER_HOUR = 3600.d0

! for the stretching of crustal elements in the case of 3D models
  double precision, parameter :: MARS_MAX_RATIO_CRUST_STRETCHING = 0.9d0 ! choose ratio < 1 for stretching effect
  double precision, parameter :: MARS_RMOHO_STRETCH_ADJUSTMENT = 0.d0 ! moho at 110 km
  double precision, parameter :: MARS_R80_STRETCH_ADJUSTMENT =   0.d0 ! r80  at 334.5 km

!!double precision, parameter :: MARS_MAX_RATIO_CRUST_STRETCHING = 0.7d0 ! choose ratio < 1 for stretching effect
!!double precision, parameter :: MARS_RMOHO_STRETCH_ADJUSTMENT = -10000.d0 ! moho down to 120 km
!!double precision, parameter :: MARS_R80_STRETCH_ADJUSTMENT =   -20000.d0 ! r80 down to 120km

! adapted regional moho stretching (use only for special areas to optimize a local mesh)
! 1~6 chunk simulation, 5-layer crust
  logical, parameter :: MARS_REGIONAL_MOHO_MESH = .false.
  logical, parameter :: MARS_HONOR_DEEP_MOHO = .false.


!!-----------------------------------------------------------
!!
!! Moon
!!
!!-----------------------------------------------------------
! Model Moon
!
! mostly based on VPREMOON model:
! Garcia, R.F., J. Gagnepain-Beyneix, S. Chevrot and Ph. Lognonne, 2011.
! Very preliminary reference Moon model,
! Physics of the Earth and Planetary Interiors, 188, 96-113.
!
! NASA fact infos: https://nssdc.gsfc.nasa.gov/planetary/factsheet/moonfact.html
! some of these NASA values are different with respect to the seismologically preferred ones below.
!
! average Moon radius
  double precision, parameter :: MOON_R = 1737100.d0
  double precision, parameter :: R_MOON = MOON_R

! radius of the Moon in km
  double precision, parameter :: MOON_R_KM = MOON_R / 1000.d0
  double precision, parameter :: R_MOON_KM = MOON_R_KM

! average density in the full MOON to normalize equation
  double precision, parameter :: MOON_RHOAV = 3344.0d0    ! from NASA fact sheet

! Topography
!--- 4-minute model
  integer, parameter :: MOON_NX_BATHY_4 = 5400,MOON_NY_BATHY_4 = 2700
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_4 = 4.0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_4 = 'DATA/topo_bathy/topo_bathy_moon4_smoothed_window_0.dat.bin'
!--- 2-minute
  integer, parameter :: MOON_NX_BATHY_2 = 10800,MOON_NY_BATHY_2 = 5400
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_2 = 2.0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_2 = 'DATA/topo_bathy/topo_bathy_moon2_smoothed_window_0.dat.bin'
!--- 1-minute
  integer, parameter :: MOON_NX_BATHY_1 = 21600,MOON_NY_BATHY_1 = 10800
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_1 = 1.0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_1 = 'DATA/topo_bathy/topo_bathy_moon1_smoothed_window_0.dat.bin'
!--- custom resolution < 1-minute model
! size of topography and bathymetry file
  integer, parameter :: MOON_NX_BATHY_C = 23040,MOON_NY_BATHY_C = 11520
! resolution of topography file in minutes
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE_C = 0.94d0
! pathname of the topography file
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE_C = 'DATA/topo_bathy/interface.bin'
!--- Default
! Topography defaults to 4-minute
  integer, parameter :: MOON_NX_BATHY = MOON_NX_BATHY_4
  integer, parameter :: MOON_NY_BATHY = MOON_NY_BATHY_4
  double precision, parameter :: MOON_RESOLUTION_TOPO_FILE = MOON_RESOLUTION_TOPO_FILE_4
  character (len=*), parameter :: MOON_PATHNAME_TOPO_FILE = MOON_PATHNAME_TOPO_FILE_4

! Topography value min/max range
  integer, parameter :: MOON_TOPO_MINIMUM = -9130 ! (max depth in m)
  integer, parameter :: MOON_TOPO_MAXIMUM = 10780 ! (height in m)

! For the reference ellipsoid to convert geographic latitudes to geocentric:
! Moon flattening:
! NASA fact sheet has flattening = 0.0012 = 1/833.3
!
! Note: Steinberger et al. (2015, PEPI 245, 26-39) argue that due to non-equilibrum flattening of the Moon
!       there is no reference ellipsoid to refer to. Thus, they prefer a sphere with a "frozen"-in shape.
!
!       We could in principle do the same, as the Moon topography is also given in absolute values (radius).
!       However, for now we take topography as the +/- elevation value with respect to a reference surface radius.
!
! For flattening, here preferred: 1/901 = 0.00110987791
  double precision, parameter :: MOON_FLATTENING_F = 1.d0 / 901.0d0
  double precision, parameter :: MOON_ONE_MINUS_F_SQUARED = (1.d0 - MOON_FLATTENING_F)**2

! doubling layers
  double precision, parameter :: MOON_DEPTH_SECOND_DOUBLING_OPTIMAL = 771000.d0    ! between RTOPDDOUBLEPRIME and R771
  double precision, parameter :: MOON_DEPTH_THIRD_DOUBLING_OPTIMAL  = 1380000.d0    ! inside outer core (closer to top)
  double precision, parameter :: MOON_DEPTH_FOURTH_DOUBLING_OPTIMAL = 1420000.d0    ! inside outer core (closer to bottom)

! standard gravity at the surface
  double precision, parameter :: MOON_STANDARD_GRAVITY = 1.62d0 ! in m.s-2

! shortest radius at which crust is implemented (39 km depth)
! we impose the crust only above it
  double precision, parameter :: MOON_R_DEEPEST_CRUST = (MOON_R - 39000.d0) / MOON_R

! number of hours per day for rotation rate of the Moon
  double precision, parameter :: MOON_HOURS_PER_DAY = 27.322d0
  double precision, parameter :: MOON_SECONDS_PER_HOUR = 3600.d0

! for the stretching of crustal elements in the case of 3D models
  double precision, parameter :: MOON_MAX_RATIO_CRUST_STRETCHING = 0.7d0 ! 0.75
  double precision, parameter :: MOON_RMOHO_STRETCH_ADJUSTMENT = -10000.d0 ! moho down
  double precision, parameter :: MOON_R80_STRETCH_ADJUSTMENT =   -20000.d0 ! r80 down

! adapted regional moho stretching (use only for special areas to optimize a local mesh)
  logical, parameter :: MOON_REGIONAL_MOHO_MESH = .false.
  logical, parameter :: MOON_HONOR_DEEP_MOHO = .false.


!!-----------------------------------------------------------
!!
!! Spectral infinite-element mesh
!!
!!-----------------------------------------------------------

! transition-to-infinite and infinite regions
  logical, parameter :: ADD_TRINF = .true.
  integer, parameter :: NLAYER_TRINF = 10           ! default 10

! pole position for infinite element region
! center of the Earth
  double precision, dimension(NDIM), parameter :: POLE_INF = (/ 0.d0, 0.d0, 0.d0 /)
! or
!! center of the source or disturbance
!!  double precision, dimension(NDIM), parameter :: POLE_INF = (/ -0.6334289d0, 0.4764568d0, 0.6045561d0 /)

! degrees of freedoms
  integer, parameter :: NNDOFU   = 0 ! displacement components
  integer, parameter :: NNDOFCHI = 0 ! displacement potential
  integer, parameter :: NNDOFP   = 0 ! pressure
  integer, parameter :: NNDOFPHI = 1 ! gravitational potential

! all nodal freedoms
  integer, parameter :: NNDOF    = NNDOFU + NNDOFCHI + NNDOFP + NNDOFPHI

! number of GLL points in each direction of an element (degree plus one)
  integer, parameter :: NGLLX_INF = 3
  integer, parameter :: NGLLY_INF = NGLLX_INF
  integer, parameter :: NGLLZ_INF = NGLLX_INF
  integer, parameter :: NGLLCUBE_INF = NGLLX_INF * NGLLY_INF * NGLLZ_INF

!------------------------------------------------------------
! Level-1 solver
!------------------------------------------------------------
  integer, parameter :: NEDOFU1   = NGLLCUBE_INF * NNDOFU, &
                        NEDOFCHI1 = NGLLCUBE_INF * NNDOFCHI, &
                        NEDOFP1   = NGLLCUBE_INF * NNDOFP, &
                        NEDOFPHI1 = NGLLCUBE_INF * NNDOFPHI

  integer, parameter :: NEDOF1    = NGLLCUBE_INF * NNDOF

!------------------------------------------------------------
! Level-2 solver
!------------------------------------------------------------
  integer, parameter :: NEDOFU   = NGLLCUBE * NNDOFU, &
                        NEDOFCHI = NGLLCUBE * NNDOFCHI, &
                        NEDOFP   = NGLLCUBE * NNDOFP, &
                        NEDOFPHI = NGLLCUBE * NNDOFPHI

  integer, parameter :: NEDOF    = NGLLCUBE * NNDOF

!!-----------------------------------------------------------
!!
!! Poisson's solver
!!
!!-----------------------------------------------------------

! maximum number of iteration for conjugate gradient solver
  integer, parameter :: ISOLVER_BUILTIN = 0, ISOLVER_PETSC = 1

! Level-2 solver
  logical, parameter :: USE_POISSON_SOLVER_5GLL = .false.

! If the following parameter is .true., contribution of the perturbed gravity is discarded in compute force routines
! (perturbed gravity is still computed from the density perturbation)
  logical, parameter :: DISCARD_GCONTRIB = .false.

[danielpeter]

this looks more like an issue with the MPI library that is linked to your executable. running the configure script might have taken a wrong MPI library path.

check what modules are loaded on your compute node and try to link against the correct ones with MPI_INC and MPI_LIB when running the configure script.

[dosoe]

Hi Daniel,
You are correct, it turns out the compilers on my cluster changed since the last time I ran specfem.
It is running now, I'll be back once the benchmarks are done.
I'm not sure how much all the little changes impact the output (like changing the minimal ocean depth by 50 meters) but if I understand correctly, the differences are due to improvements to the code, so we should use the newer version and not use USE_OLD_VERSION_FORMAT=.true.? Once the benchmarks are successful, we might want to have that discussion.

[dosoe]

Hi Daniel,
I ran the benchmarks again, but there is basically no difference. Actually, there is so little difference that I double-checked that I ran the right code, but it is the right code for sure.

[dosoe]

Here is output_mesher.txt for our version of specfem

 
 ****************************
 *** Specfem3D MPI Mesher ***
 ****************************
 
 
 There are          294  MPI processes
 Processes are numbered from 0 to          293
 
 There are          112  elements along xi in each chunk
 There are          112  elements along eta in each chunk
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks in the global mesh
 There is a total of          294  slices in the global mesh
 
 NGLLX =            5
 NGLLY =            5
 NGLLZ =            5
 
 Shape functions defined by NGNOD =           27  control nodes
 Surface shape functions defined by NGNOD2D =            9  control nodes
 
 model: SEMUCB_A3d
   incorporating the oceans using equivalent load
   incorporating ellipticity
   incorporating surface topography
   incorporating self-gravitation (Cowling approximation)
   incorporating rotation
   incorporating attenuation using            3  standard linear solids
 
   incorporating 3-D lateral variations
   no heterogeneities in the mantle
   incorporating crustal variations
   using one layer only in PREM crust
   incorporating anisotropy
   no inner-core anisotropy
   no general mantle anisotropy
 
 Reference radius of the Earth used is    6371.00000000000       km
 
 Central cube is at a radius of    950.000000000000       km
 creating global slice addressing
 
 Spatial distribution of the slices
                       48   41   34   27   20   13    6
                       47   40   33   26   19   12    5
                       46   39   32   25   18   11    4
                       45   38   31   24   17   10    3
                       44   37   30   23   16    9    2
                       43   36   29   22   15    8    1
                       42   35   28   21   14    7    0
  
   146  139  132  125  118  111  104      97   90   83   76   69   62   55     244  237  230  223  216  209  202
   145  138  131  124  117  110  103      96   89   82   75   68   61   54     243  236  229  222  215  208  201
   144  137  130  123  116  109  102      95   88   81   74   67   60   53     242  235  228  221  214  207  200
   143  136  129  122  115  108  101      94   87   80   73   66   59   52     241  234  227  220  213  206  199
   142  135  128  121  114  107  100      93   86   79   72   65   58   51     240  233  226  219  212  205  198
   141  134  127  120  113  106   99      92   85   78   71   64   57   50     239  232  225  218  211  204  197
   140  133  126  119  112  105   98      91   84   77   70   63   56   49     238  231  224  217  210  203  196
  
                      293  286  279  272  265  258  251
                      292  285  278  271  264  257  250
                      291  284  277  270  263  256  249
                      290  283  276  269  262  255  248
                      289  282  275  268  261  254  247
                      288  281  274  267  260  253  246
                      287  280  273  266  259  252  245
  
                      195  188  181  174  167  160  153
                      194  187  180  173  166  159  152
                      193  186  179  172  165  158  151
                      192  185  178  171  164  157  150
                      191  184  177  170  163  156  149
                      190  183  176  169  162  155  148
                      189  182  175  168  161  154  147
  
 
 
 Radial Meshing parameters:
   NCHUNKS                =            6
 
   CENTER LAT/LON:            0.0000000E+00 /  0.0000000E+00
   GAMMA_ROTATION_AZIMUTH:    0.0000000E+00
 
   CHUNK WIDTH XI/ETA:         90.00000     /   90.00000    
   NEX XI/ETA:                       112 /         112
 
   NER_CRUST:                          2
   NER_80_MOHO:                        1
   NER_220_80:                         2
   NER_400_220:                        2
   NER_600_400:                        2
   NER_670_600:                        1
   NER_771_670:                        1
   NER_TOPDDOUBLEPRIME_771:           15
   NER_CMB_TOPDDOUBLEPRIME:            1
   NER_OUTER_CORE:                    16
   NER_TOP_CENTRAL_CUBE_ICB:           2
   SUPPRESS_CRUSTAL_MESH:    F
 
   R_CENTRAL_CUBE =    950.0000      km
 
 Mesh resolution:
   DT =   0.142500000000000     
 
 
 
 *******************************************
 creating mesh in region            1
 this region is the crust and mantle
 *******************************************
 
 
 first pass
 
   ...allocating arrays 
 
   ...setting up layers 
 
   ...creating mesh elements 
   creating layer            1 out of           10
     10.0%    current clock (NOT elapsed) time is: 17h 36min 27sec
   creating layer            2 out of           10
     20.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            3 out of           10
     30.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            4 out of           10
     40.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            5 out of           10
     50.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            6 out of           10
     60.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            7 out of           10
     70.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            8 out of           10
     80.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer            9 out of           10
     90.0%    current clock (NOT elapsed) time is: 17h 36min 31sec
   creating layer           10 out of           10
    100.0%    current clock (NOT elapsed) time is: 17h 36min 45sec
 
 
   ...creating global addressing
 
   ...creating MPI buffers
 
 second pass
 
   ...allocating arrays 
 
   ...setting up layers 
 
   ...creating mesh elements 
   creating layer            1 out of           10
     10.0%    current clock (NOT elapsed) time is: 17h 37min 28sec
   creating layer            2 out of           10
     20.0%    current clock (NOT elapsed) time is: 17h 37min 37sec
   creating layer            3 out of           10
     30.0%    current clock (NOT elapsed) time is: 17h 37min 37sec
   creating layer            4 out of           10
     40.0%    current clock (NOT elapsed) time is: 17h 37min 47sec
   creating layer            5 out of           10
     50.0%    current clock (NOT elapsed) time is: 17h 38min 06sec
   creating layer            6 out of           10
     60.0%    current clock (NOT elapsed) time is: 17h 38min 09sec
   creating layer            7 out of           10
     70.0%    current clock (NOT elapsed) time is: 17h 38min 12sec
   creating layer            8 out of           10
     80.0%    current clock (NOT elapsed) time is: 17h 38min 17sec
   creating layer            9 out of           10
     90.0%    current clock (NOT elapsed) time is: 17h 38min 23sec
   creating layer           10 out of           10
    100.0%    current clock (NOT elapsed) time is: 17h 40min 01sec
 
 
   ...precomputing Jacobian
 
   ...creating chunk buffers
 
 ----- creating chunk buffers -----
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 There is a total of           84  messages to assemble faces between chunks
 
 Generating message            1  for faces out of           84
 Generating message            2  for faces out of           84
 Generating message            3  for faces out of           84
 Generating message            4  for faces out of           84
 Generating message            5  for faces out of           84
 Generating message            6  for faces out of           84
 Generating message            7  for faces out of           84
 Generating message            8  for faces out of           84
 Generating message            9  for faces out of           84
 Generating message           10  for faces out of           84
 Generating message           11  for faces out of           84
 Generating message           12  for faces out of           84
 Generating message           13  for faces out of           84
 Generating message           14  for faces out of           84
 Generating message           15  for faces out of           84
 Generating message           16  for faces out of           84
 Generating message           17  for faces out of           84
 Generating message           18  for faces out of           84
 Generating message           19  for faces out of           84
 Generating message           20  for faces out of           84
 Generating message           21  for faces out of           84
 Generating message           22  for faces out of           84
 Generating message           23  for faces out of           84
 Generating message           24  for faces out of           84
 Generating message           25  for faces out of           84
 Generating message           26  for faces out of           84
 Generating message           27  for faces out of           84
 Generating message           28  for faces out of           84
 Generating message           29  for faces out of           84
 Generating message           30  for faces out of           84
 Generating message           31  for faces out of           84
 Generating message           32  for faces out of           84
 Generating message           33  for faces out of           84
 Generating message           34  for faces out of           84
 Generating message           35  for faces out of           84
 Generating message           36  for faces out of           84
 Generating message           37  for faces out of           84
 Generating message           38  for faces out of           84
 Generating message           39  for faces out of           84
 Generating message           40  for faces out of           84
 Generating message           41  for faces out of           84
 Generating message           42  for faces out of           84
 Generating message           43  for faces out of           84
 Generating message           44  for faces out of           84
 Generating message           45  for faces out of           84
 Generating message           46  for faces out of           84
 Generating message           47  for faces out of           84
 Generating message           48  for faces out of           84
 Generating message           49  for faces out of           84
 Generating message           50  for faces out of           84
 Generating message           51  for faces out of           84
 Generating message           52  for faces out of           84
 Generating message           53  for faces out of           84
 Generating message           54  for faces out of           84
 Generating message           55  for faces out of           84
 Generating message           56  for faces out of           84
 Generating message           57  for faces out of           84
 Generating message           58  for faces out of           84
 Generating message           59  for faces out of           84
 Generating message           60  for faces out of           84
 Generating message           61  for faces out of           84
 Generating message           62  for faces out of           84
 Generating message           63  for faces out of           84
 Generating message           64  for faces out of           84
 Generating message           65  for faces out of           84
 Generating message           66  for faces out of           84
 Generating message           67  for faces out of           84
 Generating message           68  for faces out of           84
 Generating message           69  for faces out of           84
 Generating message           70  for faces out of           84
 Generating message           71  for faces out of           84
 Generating message           72  for faces out of           84
 Generating message           73  for faces out of           84
 Generating message           74  for faces out of           84
 Generating message           75  for faces out of           84
 Generating message           76  for faces out of           84
 Generating message           77  for faces out of           84
 Generating message           78  for faces out of           84
 Generating message           79  for faces out of           84
 Generating message           80  for faces out of           84
 Generating message           81  for faces out of           84
 Generating message           82  for faces out of           84
 Generating message           83  for faces out of           84
 Generating message           84  for faces out of           84
 
 all the messages for chunk faces have the right size
 
 Generating message            1  for corners out of            8
 Generating message            2  for corners out of            8
 Generating message            3  for corners out of            8
 Generating message            4  for corners out of            8
 Generating message            5  for corners out of            8
 Generating message            6  for corners out of            8
 Generating message            7  for corners out of            8
 Generating message            8  for corners out of            8
 
   ...preparing MPI interfaces
 
 crust/mantle region:
   #max of points in MPI buffers along xi npoin2D_xi =         3669
   #max of array elements transferred npoin2D_xi*NDIM =        11007
 
   #max of points in MPI buffers along eta npoin2D_eta =         3669
   #max of array elements transferred npoin2D_eta*NDIM =        11007
 
 crust mantle MPI:
   maximum interfaces:           8
   MPI addressing maximum interfaces:           8
   MPI addressing : all interfaces okay
 
   total MPI interface points :      4440312
   unique MPI interface points:      4186560
   maximum valence            :            3
   total unique MPI interface points:     4186560
 
 
   ...element inner/outer separation 
 
 for overlapping of communications with calculations:
 
 percentage of edge elements in crust/mantle    38.33333     %
 percentage of volume elements in crust/mantle    61.66667     %
 
 
   ...element mesh coloring 
   mesh coloring:  F
 
   ...creating mass matrix
     updates mass matrix with ocean load
 
   ...saving binary files
 
    calculated top area:    12.5574512310349     
 calculated bottom area:    3.74933392549595     
 
   ...saving AVS or DX mesh files
 
 *******************************************
 creating mesh in region            2
 this region is the outer core
 *******************************************
 
 
 first pass
 
   ...allocating arrays 
 
   ...setting up layers 
 
   ...creating mesh elements 
   creating layer            1 out of            2
     50.0%    current clock (NOT elapsed) time is: 17h 43min 51sec
   creating layer            2 out of            2
    100.0%    current clock (NOT elapsed) time is: 17h 43min 51sec
 
 
   ...creating global addressing
 
   ...creating MPI buffers
 
 second pass
 
   ...allocating arrays 
 
   ...setting up layers 
 
   ...creating mesh elements 
   creating layer            1 out of            2
     50.0%    current clock (NOT elapsed) time is: 17h 43min 51sec
   creating layer            2 out of            2
    100.0%    current clock (NOT elapsed) time is: 17h 43min 51sec
 
 
   ...precomputing Jacobian
 
   ...creating chunk buffers
 
 ----- creating chunk buffers -----
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 There is a total of           84  messages to assemble faces between chunks
 
 Generating message            1  for faces out of           84
 Generating message            2  for faces out of           84
 Generating message            3  for faces out of           84
 Generating message            4  for faces out of           84
 Generating message            5  for faces out of           84
 Generating message            6  for faces out of           84
 Generating message            7  for faces out of           84
 Generating message            8  for faces out of           84
 Generating message            9  for faces out of           84
 Generating message           10  for faces out of           84
 Generating message           11  for faces out of           84
 Generating message           12  for faces out of           84
 Generating message           13  for faces out of           84
 Generating message           14  for faces out of           84
 Generating message           15  for faces out of           84
 Generating message           16  for faces out of           84
 Generating message           17  for faces out of           84
 Generating message           18  for faces out of           84
 Generating message           19  for faces out of           84
 Generating message           20  for faces out of           84
 Generating message           21  for faces out of           84
 Generating message           22  for faces out of           84
 Generating message           23  for faces out of           84
 Generating message           24  for faces out of           84
 Generating message           25  for faces out of           84
 Generating message           26  for faces out of           84
 Generating message           27  for faces out of           84
 Generating message           28  for faces out of           84
 Generating message           29  for faces out of           84
 Generating message           30  for faces out of           84
 Generating message           31  for faces out of           84
 Generating message           32  for faces out of           84
 Generating message           33  for faces out of           84
 Generating message           34  for faces out of           84
 Generating message           35  for faces out of           84
 Generating message           36  for faces out of           84
 Generating message           37  for faces out of           84
 Generating message           38  for faces out of           84
 Generating message           39  for faces out of           84
 Generating message           40  for faces out of           84
 Generating message           41  for faces out of           84
 Generating message           42  for faces out of           84
 Generating message           43  for faces out of           84
 Generating message           44  for faces out of           84
 Generating message           45  for faces out of           84
 Generating message           46  for faces out of           84
 Generating message           47  for faces out of           84
 Generating message           48  for faces out of           84
 Generating message           49  for faces out of           84
 Generating message           50  for faces out of           84
 Generating message           51  for faces out of           84
 Generating message           52  for faces out of           84
 Generating message           53  for faces out of           84
 Generating message           54  for faces out of           84
 Generating message           55  for faces out of           84
 Generating message           56  for faces out of           84
 Generating message           57  for faces out of           84
 Generating message           58  for faces out of           84
 Generating message           59  for faces out of           84
 Generating message           60  for faces out of           84
 Generating message           61  for faces out of           84
 Generating message           62  for faces out of           84
 Generating message           63  for faces out of           84
 Generating message           64  for faces out of           84
 Generating message           65  for faces out of           84
 Generating message           66  for faces out of           84
 Generating message           67  for faces out of           84
 Generating message           68  for faces out of           84
 Generating message           69  for faces out of           84
 Generating message           70  for faces out of           84
 Generating message           71  for faces out of           84
 Generating message           72  for faces out of           84
 Generating message           73  for faces out of           84
 Generating message           74  for faces out of           84
 Generating message           75  for faces out of           84
 Generating message           76  for faces out of           84
 Generating message           77  for faces out of           84
 Generating message           78  for faces out of           84
 Generating message           79  for faces out of           84
 Generating message           80  for faces out of           84
 Generating message           81  for faces out of           84
 Generating message           82  for faces out of           84
 Generating message           83  for faces out of           84
 Generating message           84  for faces out of           84
 
 all the messages for chunk faces have the right size
 
 Generating message            1  for corners out of            8
 Generating message            2  for corners out of            8
 Generating message            3  for corners out of            8
 Generating message            4  for corners out of            8
 Generating message            5  for corners out of            8
 Generating message            6  for corners out of            8
 Generating message            7  for corners out of            8
 Generating message            8  for corners out of            8
 
   ...preparing MPI interfaces
 
 outer core region:
   #max of points in MPI buffers along xi npoin2D_xi =          877
   #max of array elements transferred npoin2D_xi*NDIM =         2631
 
   #max of points in MPI buffers along eta npoin2D_eta =          877
   #max of array elements transferred npoin2D_eta*NDIM =         2631
 
 outer core MPI:
   maximum interfaces:           8
   MPI addressing maximum interfaces:           8
   MPI addressing : all interfaces okay
 
   total MPI interface points :      1106232
   unique MPI interface points:       954912
   maximum valence            :            3
   total assembled MPI interface points:      954912
 
 
   ...element inner/outer separation 
 percentage of edge elements in outer core    81.39535     %
 percentage of volume elements in outer core    18.60465     %
 
 
   ...element mesh coloring 
   mesh coloring:  F
 
   ...creating mass matrix
 
   ...saving binary files
 
    calculated top area:    3.74933392549595     
 calculated bottom area:   0.461936527995823     
 
   ...saving AVS or DX mesh files
 
 *******************************************
 creating mesh in region            3
 this region is the inner core
 *******************************************
 
 
 first pass
 
   ...allocating arrays 
 
   ...setting up layers 
 
   ...creating mesh elements 
   creating layer            1 out of            1
    100.0%    current clock (NOT elapsed) time is: 17h 43min 52sec
 
   creating central cube
 
   ...creating global addressing
 
   ...creating MPI buffers
 
 second pass
 
   ...allocating arrays 
 
   ...setting up layers 
 
   ...creating mesh elements 
   creating layer            1 out of            1
    100.0%    current clock (NOT elapsed) time is: 17h 43min 52sec
 
   creating central cube
 
   ...precomputing Jacobian
 
   ...creating chunk buffers
 
 ----- creating chunk buffers -----
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 There is a total of           84  messages to assemble faces between chunks
 
 Generating message            1  for faces out of           84
 Generating message            2  for faces out of           84
 Generating message            3  for faces out of           84
 Generating message            4  for faces out of           84
 Generating message            5  for faces out of           84
 Generating message            6  for faces out of           84
 Generating message            7  for faces out of           84
 Generating message            8  for faces out of           84
 Generating message            9  for faces out of           84
 Generating message           10  for faces out of           84
 Generating message           11  for faces out of           84
 Generating message           12  for faces out of           84
 Generating message           13  for faces out of           84
 Generating message           14  for faces out of           84
 Generating message           15  for faces out of           84
 Generating message           16  for faces out of           84
 Generating message           17  for faces out of           84
 Generating message           18  for faces out of           84
 Generating message           19  for faces out of           84
 Generating message           20  for faces out of           84
 Generating message           21  for faces out of           84
 Generating message           22  for faces out of           84
 Generating message           23  for faces out of           84
 Generating message           24  for faces out of           84
 Generating message           25  for faces out of           84
 Generating message           26  for faces out of           84
 Generating message           27  for faces out of           84
 Generating message           28  for faces out of           84
 Generating message           29  for faces out of           84
 Generating message           30  for faces out of           84
 Generating message           31  for faces out of           84
 Generating message           32  for faces out of           84
 Generating message           33  for faces out of           84
 Generating message           34  for faces out of           84
 Generating message           35  for faces out of           84
 Generating message           36  for faces out of           84
 Generating message           37  for faces out of           84
 Generating message           38  for faces out of           84
 Generating message           39  for faces out of           84
 Generating message           40  for faces out of           84
 Generating message           41  for faces out of           84
 Generating message           42  for faces out of           84
 Generating message           43  for faces out of           84
 Generating message           44  for faces out of           84
 Generating message           45  for faces out of           84
 Generating message           46  for faces out of           84
 Generating message           47  for faces out of           84
 Generating message           48  for faces out of           84
 Generating message           49  for faces out of           84
 Generating message           50  for faces out of           84
 Generating message           51  for faces out of           84
 Generating message           52  for faces out of           84
 Generating message           53  for faces out of           84
 Generating message           54  for faces out of           84
 Generating message           55  for faces out of           84
 Generating message           56  for faces out of           84
 Generating message           57  for faces out of           84
 Generating message           58  for faces out of           84
 Generating message           59  for faces out of           84
 Generating message           60  for faces out of           84
 Generating message           61  for faces out of           84
 Generating message           62  for faces out of           84
 Generating message           63  for faces out of           84
 Generating message           64  for faces out of           84
 Generating message           65  for faces out of           84
 Generating message           66  for faces out of           84
 Generating message           67  for faces out of           84
 Generating message           68  for faces out of           84
 Generating message           69  for faces out of           84
 Generating message           70  for faces out of           84
 Generating message           71  for faces out of           84
 Generating message           72  for faces out of           84
 Generating message           73  for faces out of           84
 Generating message           74  for faces out of           84
 Generating message           75  for faces out of           84
 Generating message           76  for faces out of           84
 Generating message           77  for faces out of           84
 Generating message           78  for faces out of           84
 Generating message           79  for faces out of           84
 Generating message           80  for faces out of           84
 Generating message           81  for faces out of           84
 Generating message           82  for faces out of           84
 Generating message           83  for faces out of           84
 Generating message           84  for faces out of           84
 
 all the messages for chunk faces have the right size
 
 Generating message            1  for corners out of            8
 Generating message            2  for corners out of            8
 Generating message            3  for corners out of            8
 Generating message            4  for corners out of            8
 Generating message            5  for corners out of            8
 Generating message            6  for corners out of            8
 Generating message            7  for corners out of            8
 Generating message            8  for corners out of            8
 
   ...preparing MPI interfaces
 
 inner core region:
   #max of points in MPI buffers along xi npoin2D_xi =          585
   #max of array elements transferred npoin2D_xi*NDIM =         1755
 
   #max of points in MPI buffers along eta npoin2D_eta =          585
   #max of array elements transferred npoin2D_eta*NDIM =         1755
 
 
 including central cube
 
 inner core MPI:
 inner core with central cube MPI:
   maximum interfaces:          27
   MPI addressing maximum interfaces:          27
   MPI addressing : all interfaces okay
 
   total MPI interface points :       247410
   unique MPI interface points:       186886
   maximum valence            :            7
   total assembled MPI interface points:      186886
 
 
   ...element inner/outer separation 
 percentage of edge elements in inner core    62.50000     %
 percentage of volume elements in inner core    37.50000     %
 
 
   ...element mesh coloring 
   mesh coloring:  F
 
   ...creating mass matrix
 
   ...saving binary files
 
    calculated top area:   0.461936527995823     
 calculated bottom area:   0.211696686084206     
 
   ...saving AVS or DX mesh files
 
 calculated volume:    4.18409803678323     
 
 computed total Earth mass for this density model and mesh: 
  5.979248025524513E+024  kg
    (should be not too far from 5.97E+24 kg)
 
 average density for this density model and mesh:    5526.14023536718       kg/m
 3
    (should be not too far from 5514 kg/m3)
 
 Repartition of elements in regions:
 ----------------------------------
 
 total number of elements in each slice:         2396
 
  - crust and mantle:    90.15025      %
  - outer core:    7.178631      %
  - inner core:    2.671118      %
 
 for some mesh statistics, see comments in file OUTPUT_FILES/values_from_mesher.
 h
 
 Load balancing = 100 % by definition
 
 
 total number of time steps in the solver will be:        42200
 
 
 time-stepping of the solver will be:   0.142500000000000     
 
 using single precision for the calculations
 
 smallest and largest possible floating-point numbers are:   1.1754944E-38
  3.4028235E+38
 
 
 Elapsed time for mesh generation and buffer creation in seconds = 
   461.150877129000     
 Elapsed time for mesh generation and buffer creation in hh:mm:ss =    0 h 07 m 41 s
 
 End of mesh generation
 

[dosoe]

Here is output_solver.txt for our version of specfem

 
 ******************************
 **** Specfem3D MPI Solver ****
 ******************************
 
 
 Fixing slow underflow trapping problem using small initial field
 
 There are          294  MPI processes
 Processes are numbered from 0 to          293
 
 There are          112  elements along xi in each chunk
 There are          112  elements along eta in each chunk
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 NDIM =            3
 
 NGLLX =            5
 NGLLY =            5
 NGLLZ =            5
 
 using single precision for the calculations
 
 smallest and largest possible floating-point numbers are:   1.1754944E-38
  3.4028235E+38
 
 model: SEMUCB_A3d
   incorporating the oceans using equivalent load
   incorporating ellipticity
   incorporating surface topography
   incorporating self-gravitation (Cowling approximation)
   incorporating rotation
   incorporating attenuation using            3  standard linear solids
 
   incorporating 3-D lateral variations
   no heterogeneities in the mantle
   incorporating crustal variations
   using one layer only in PREM crust
   incorporating transverse isotropy
   no inner-core anisotropy
   no general mantle anisotropy
 
 
 mesh databases:
   reading in crust/mantle databases...
   reading in outer core databases...
   reading in inner core databases...
   reading in coupling surface databases...
   reading in addressing...
 Spatial distribution of the slices
                       48   41   34   27   20   13    6
                       47   40   33   26   19   12    5
                       46   39   32   25   18   11    4
                       45   38   31   24   17   10    3
                       44   37   30   23   16    9    2
                       43   36   29   22   15    8    1
                       42   35   28   21   14    7    0
  
   146  139  132  125  118  111  104      97   90   83   76   69   62   55     244  237  230  223  216  209  202
   145  138  131  124  117  110  103      96   89   82   75   68   61   54     243  236  229  222  215  208  201
   144  137  130  123  116  109  102      95   88   81   74   67   60   53     242  235  228  221  214  207  200
   143  136  129  122  115  108  101      94   87   80   73   66   59   52     241  234  227  220  213  206  199
   142  135  128  121  114  107  100      93   86   79   72   65   58   51     240  233  226  219  212  205  198
   141  134  127  120  113  106   99      92   85   78   71   64   57   50     239  232  225  218  211  204  197
   140  133  126  119  112  105   98      91   84   77   70   63   56   49     238  231  224  217  210  203  196
  
                      293  286  279  272  265  258  251
                      292  285  278  271  264  257  250
                      291  284  277  270  263  256  249
                      290  283  276  269  262  255  248
                      289  282  275  268  261  254  247
                      288  281  274  267  260  253  246
                      287  280  273  266  259  252  245
  
                      195  188  181  174  167  160  153
                      194  187  180  173  166  159  152
                      193  186  179  172  165  158  151
                      192  185  178  171  164  157  150
                      191  184  177  170  163  156  149
                      190  183  176  169  162  155  148
                      189  182  175  168  161  154  147
  
   reading in MPI databases...
   for overlapping of communications with calculations:
 
   percentage of edge elements in crust/mantle    38.33333     %
   percentage of volume elements in crust/mantle    61.66667     %
 
   percentage of edge elements in outer core    81.39535     %
   percentage of volume elements in outer core    18.60465     %
 
   percentage of edge elements in inner core    62.50000     %
   percentage of volume elements in inner core    37.50000     %
 
 
 Elapsed time for reading mesh in seconds =   0.4823872    
 
 topography:
 
 Elapsed time for reading topo/bathy in seconds =   0.3818414    
 
 
 sources:
 
 *************************************
  locating source            1
 *************************************
 
 source located in slice          191
                in element         1979
 
    xi coordinate of source in that element:  -0.852879481076005     
   eta coordinate of source in that element:   0.615981562454355     
 gamma coordinate of source in that element:  -0.106986782522646     
 
  half duration:    2.20000000000000       seconds
     time shift:   0.000000000000000E+000  seconds
 
 original (requested) position of the source:
 
       latitude:    9.06000000000000     
      longitude:    126.810000000000     
          depth:    19.0000000000000       km
 
 position of the source that will be used:
 
       latitude:    9.06000016847096     
      longitude:    126.810000000000     
          depth:    18.9999999999991       km
 
 position of the source that will be used:
 
              x:  -0.590193591314124     
              y:   0.788641056183735     
              z:   0.156024834242153     
 
 error in location of the source:   1.4146462E-12  km
 
 maximum error in location of the sources:   1.4146462E-12  km
 
 
 Elapsed time for detection of sources in seconds =   2.776524300000005E-002
 
 End of source detection - done
 
 
 printing the source-time function
 
 printing the source spectrum
 
 receivers:
 
 Total number of receivers =           25
 
 
 ********************
  locating receivers
 ********************
 
 
 ****************************
 reading receiver information
 ****************************
 
 Station #           1 : ___G._CAN.US    epicentral distance:     48.86376     
  degrees
 Station #           2 : ___G._DRV.US    epicentral distance:     76.13953     
  degrees
 Station #           3 : ___G._INU.US    epicentral distance:     27.78656     
  degrees
 Station #           4 : ___G.NOUC.US    epicentral distance:     49.58525     
  degrees
 Station #           5 : ___G._PPT.US    epicentral distance:     86.68313     
  degrees
 Station #           6 : ___G._PVC.US    epicentral distance:     48.88361     
  degrees
 Station #           7 : __GE._PMG.US    epicentral distance:     27.33093     
  degrees
 Station #           8 : __IC._BJT.US    epicentral distance:     32.25808     
  degrees
 Station #           9 : __IC._XAN.US    epicentral distance:     29.80256     
  degrees
 Station #          10 : __II.MSVF.US    epicentral distance:     57.18921     
  degrees
 Station #          11 : __II._TAU.US    epicentral distance:     55.00465     
  degrees
 Station #          12 : __II.WRAB.US    epicentral distance:     29.75551     
  degrees
 Station #          13 : __IU._AFI.US    epicentral distance:     65.06213     
  degrees
 Station #          14 : __IU.CHTO.US    epicentral distance:     28.68996     
  degrees
 Station #          15 : __IU._DAV.US    epicentral distance:     2.322989     
  degrees
 Station #          16 : __IU._HNR.US    epicentral distance:     37.76685     
  degrees
 Station #          17 : __IU.MAJO.US    epicentral distance:     29.25601     
  degrees
 Station #          18 : __IU.NWAO.US    epicentral distance:     42.73927     
  degrees
 Station #          19 : __IU._PMG.US    epicentral distance:     27.33224     
  degrees
 Station #          20 : __IU._RAR.US    epicentral distance:     78.06832     
  degrees
 Station #          21 : __IU.SNZO.US    epicentral distance:     66.67061     
  degrees
 Station #          22 : __IU.TATO.US    epicentral distance:     16.61650     
  degrees
 Station #          23 : __PS._OGS.US    epicentral distance:     23.07540     
  degrees
 Station #          24 : __PS.PATS.US    epicentral distance:     31.27490     
  degrees
 Station #          25 : __PS._TSK.US    epicentral distance:     29.61530     
  degrees
 
 station #            2     ___G._DRV                       US      
      original latitude:   -66.66491    
     original longitude:    140.0021    
    epicentral distance:    76.13953    
 closest estimate found:   8.5047171E-02  km away
  in slice          275  in element         1806
  at xi,eta,gamma coordinates =   0.181684806665106       0.800338026284090     
   1.00000000000000     
 
 station #            3     ___G._INU                       US      
      original latitude:    35.35000    
     original longitude:    137.0290    
    epicentral distance:    27.78656    
 closest estimate found:   7.4342556E-02  km away
  in slice          146  in element         2124
  at xi,eta,gamma coordinates =   0.312445406601587      -4.997147305008513E-002
   1.00000000000000     
 
 station #            4     ___G.NOUC                       US      
      original latitude:   -22.09863    
     original longitude:    166.3067    
    epicentral distance:    49.58525    
 closest estimate found:   3.4986310E-02  km away
  in slice          127  in element         2020
  at xi,eta,gamma coordinates =   0.889087273247935      -0.918787834390303     
   1.00000000000000     
 
 station #            5     ___G._PPT                       US      
      original latitude:   -17.56900    
     original longitude:   -149.5760    
    epicentral distance:    86.68313    
 closest estimate found:   6.1826900E-02  km away
  in slice          106  in element         2134
  at xi,eta,gamma coordinates =  -0.874490762874247      -0.721950199249021     
   1.00000000000000     
 
 station #            6     ___G._PVC                       US      
      original latitude:   -17.74000    
     original longitude:    168.3120    
    epicentral distance:    48.88361    
 closest estimate found:   5.2756432E-02  km away
  in slice          128  in element         1694
  at xi,eta,gamma coordinates =   0.253088810611369       9.013740049407752E-002
   1.00000000000000     
 
 station #            7     __GE._PMG                       US      
      original latitude:   -9.409200    
     original longitude:    147.1539    
    epicentral distance:    27.33093    
 closest estimate found:   0.5181249      km away
  in slice          142  in element         1970
  at xi,eta,gamma coordinates =  -0.591264547627788       0.750291881971223     
   1.00000000000000     
 
 station #            8     __IC._BJT                       US      
      original latitude:    40.01830    
     original longitude:    116.1679    
    epicentral distance:    32.25808    
 closest estimate found:   5.1659271E-02  km away
  in slice          182  in element         1730
  at xi,eta,gamma coordinates =   0.223389030084709       0.128996222893111     
   1.00000000000000     
 
 station #           11     __II._TAU                       US      
      original latitude:   -42.90990    
     original longitude:    147.3204    
    epicentral distance:    55.00465    
 closest estimate found:   8.5861281E-02  km away
  in slice          288  in element         1738
  at xi,eta,gamma coordinates =  -0.454313641564828       0.405317576531873     
   1.00000000000000     
 
 station #           12     __II.WRAB                       US      
      original latitude:   -19.93360    
     original longitude:    134.3600    
    epicentral distance:    29.75551    
 closest estimate found:   1.3575530E-02  km away
  in slice          194  in element         1968
  at xi,eta,gamma coordinates =  -0.442410871646958      -0.592886717600988     
   1.00000000000000     
 
 station #           13     __IU._AFI                       US      
      original latitude:   -13.90850    
     original longitude:   -171.7827    
    epicentral distance:    65.06213    
 closest estimate found:   1.5768906E-02  km away
  in slice          114  in element         1868
  at xi,eta,gamma coordinates =   0.262061207561149       0.548058942632407     
   1.00000000000000     
 
 station #           15     __IU._DAV                       US      
      original latitude:    7.069700    
     original longitude:    125.5791    
    epicentral distance:    2.322989    
 closest estimate found:   0.3466466      km away
  in slice          191  in element         2074
  at xi,eta,gamma coordinates =  -0.437282143219310      -0.447540788156585     
   1.00000000000000     
 
 station #           16     __IU._HNR                       US      
      original latitude:   -9.438700    
     original longitude:    159.9475    
    epicentral distance:    37.76685    
 closest estimate found:   0.7332718      km away
  in slice          135  in element         2002
  at xi,eta,gamma coordinates =   0.185023092605568       0.908460097614348     
   1.00000000000000     
 
 station #           17     __IU.MAJO                       US      
      original latitude:    36.54567    
     original longitude:    138.2041    
    epicentral distance:    29.25601    
 closest estimate found:   2.2067733E-02  km away
  in slice          146  in element         2152
  at xi,eta,gamma coordinates =   0.108443957129992        1.02546444381979     
   1.00000000000000     
 
 station #           19     __IU._PMG                       US      
      original latitude:   -9.404700    
     original longitude:    147.1597    
    epicentral distance:    27.33224    
 closest estimate found:   0.5012303      km away
  in slice          142  in element         1970
  at xi,eta,gamma coordinates =  -0.576406174629153       0.735860338181789     
   1.00000000000000     
 
 station #           21     __IU.SNZO                       US      
      original latitude:   -41.30870    
     original longitude:    174.7043    
    epicentral distance:    66.67061    
 closest estimate found:   8.8978671E-02  km away
  in slice          119  in element         1806
  at xi,eta,gamma coordinates =   0.357264498134544       0.180405279218897     
   1.00000000000000     
 
 station #           22     __IU.TATO                       US      
      original latitude:    24.97350    
     original longitude:    121.4971    
    epicentral distance:    16.61650    
 closest estimate found:   0.3018750      km away
  in slice          183  in element         1808
  at xi,eta,gamma coordinates =   0.107665515145196      -0.607200513658840     
   1.00000000000000     
 
 station #           23     __PS._OGS                       US      
      original latitude:    27.05700    
     original longitude:    142.2030    
    epicentral distance:    23.07540    
 closest estimate found:   1.0824928E-02  km away
  in slice          146  in element         1664
  at xi,eta,gamma coordinates =   0.397691894146448      -0.927473723671818     
   1.00000000000000     
 
 station #           24     __PS.PATS                       US      
      original latitude:    6.836700    
     original longitude:    158.3152    
    epicentral distance:    31.27490    
 closest estimate found:   3.7507001E-02  km away
  in slice          137  in element         1686
  at xi,eta,gamma coordinates =  -0.822551993211385       0.971054792429753     
   1.00000000000000     
 
 station #           25     __PS._TSK                       US      
      original latitude:    36.21080    
     original longitude:    140.1097    
    epicentral distance:    29.61530    
 closest estimate found:   0.2028736      km away
  in slice          146  in element         2116
  at xi,eta,gamma coordinates =  -0.812885157224670       0.282559955988183     
   1.00000000000000     
 
 maximum error in location of all the receivers:   0.7332718      km
 
 Elapsed time for receiver detection in seconds =   1.549837199999993E-002
 
 End of receiver detection - done
 
 
 found a total of           25  receivers in all slices
 this total is okay
 
 source arrays:
   number of sources is            1
   size of source array                 =   1.4305115E-03 MB
                                        =   1.3969839E-06 GB
 
 seismograms:
   writing out seismograms at every NTSTEP_BETWEEN_OUTPUT_SEISMOS =         1000
   maximum number of local receivers is            4  in slice          147
   size of maximum seismogram array       =   4.5776367E-02 MB
                                          =   4.4703484E-05 GB
 
 
 Total number of samples for seismograms =        42300
 
 
 Reference radius of the Earth used is    6371.00000000000       km
 
 
 incorporating the oceans using equivalent load
 
 incorporating ellipticity
 
 incorporating surface topography
 
 incorporating self-gravitation (Cowling approximation)
 
 incorporating rotation
 
 incorporating attenuation using            3  standard linear solids
 
 
 
 preparing mass matrices
 preparing constants
 preparing gravity arrays
 preparing attenuation
 preparing wavefields
 
 Elapsed time for preparing timerun in seconds =   0.1826034    
 
 
 time loop:
 
               scheme:         Newmark
            time step:   0.1425000      s
 number of time steps:        42300
 total simulated time:    100.4051      minutes
 start time          :  -3.300000      seconds
 
 
 Starting time iteration loop...
 
 Time step #            5
 Time:  -4.5499999E-02  minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  0.0000000E+00
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.0004798E-24
 Max of strain, eps_trace_over_3_crust_mantle =  3.2537671E-26
 Max of strain, epsilondev_crust_mantle  =  8.4825816E-23
 Elapsed time in seconds =   0.369925856000000     
 Elapsed time in hh:mm:ss =    0 h 00 m 00 s
 Mean elapsed time per time step in seconds =   7.398517119999996E-002
 Time steps done =            5  out of        42300
 Time steps remaining =        42295
 Estimated remaining time in seconds =    3129.20281590400     
 Estimated remaining time in hh:mm:ss =    0 h 52 m 09 s
 Estimated total run time in seconds =    3129.57274176000     
 Estimated total run time in hh:mm:ss =    0 h 52 m 09 s
 We have done   1.1820331E-02 % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 ************************************************************
 **** BEWARE: the above time estimates are not reliable
 **** because fewer than 100 iterations have been performed
 ************************************************************
 
 Time step #          500
 Time:    1.130125      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.7792811E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.0940775E-24
 Max of strain, eps_trace_over_3_crust_mantle =  2.0032806E-16
 Max of strain, epsilondev_crust_mantle  =  3.8148770E-10
 Elapsed time in seconds =    36.4825203240000     
 Elapsed time in hh:mm:ss =    0 h 00 m 36 s
 Mean elapsed time per time step in seconds =   7.296504064800000E-002
 Time steps done =          500  out of        42300
 Time steps remaining =        41800
 Estimated remaining time in seconds =    3049.93869908640     
 Estimated remaining time in hh:mm:ss =    0 h 50 m 49 s
 Estimated total run time in seconds =    3086.42121941040     
 Estimated total run time in hh:mm:ss =    0 h 51 m 26 s
 We have done    1.182033     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         1000
 Time:    2.317625      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.0974511E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.1483850E-24
 Max of strain, eps_trace_over_3_crust_mantle =  4.2851528E-15
 Max of strain, epsilondev_crust_mantle  =  2.4062419E-09
 Elapsed time in seconds =    72.7711253730000     
 Elapsed time in hh:mm:ss =    0 h 01 m 12 s
 Mean elapsed time per time step in seconds =   7.277112537300000E-002
 Time steps done =         1000  out of        42300
 Time steps remaining =        41300
 Estimated remaining time in seconds =    3005.44747790490     
 Estimated remaining time in hh:mm:ss =    0 h 50 m 05 s
 Estimated total run time in seconds =    3078.21860327790     
 Estimated total run time in hh:mm:ss =    0 h 51 m 18 s
 We have done    2.364066     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         1500
 Time:    3.505125      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.2931923E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.2250585E-24
 Max of strain, eps_trace_over_3_crust_mantle =  6.7287815E-15
 Max of strain, epsilondev_crust_mantle  =  2.8253151E-09
 Elapsed time in seconds =    109.396634926000     
 Elapsed time in hh:mm:ss =    0 h 01 m 49 s
 Mean elapsed time per time step in seconds =   7.293108995066667E-002
 Time steps done =         1500  out of        42300
 Time steps remaining =        40800
 Estimated remaining time in seconds =    2975.58846998720     
 Estimated remaining time in hh:mm:ss =    0 h 49 m 35 s
 Estimated total run time in seconds =    3084.98510491320     
 Estimated total run time in hh:mm:ss =    0 h 51 m 24 s
 We have done    3.546099     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         2000
 Time:    4.692625      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6665101E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.1118270E-20
 Max of strain, eps_trace_over_3_crust_mantle =  1.2526775E-14
 Max of strain, epsilondev_crust_mantle  =  8.1013951E-10
 Elapsed time in seconds =    146.153509154000     
 Elapsed time in hh:mm:ss =    0 h 02 m 26 s
 Mean elapsed time per time step in seconds =   7.307675457700000E-002
 Time steps done =         2000  out of        42300
 Time steps remaining =        40300
 Estimated remaining time in seconds =    2944.99320945310     
 Estimated remaining time in hh:mm:ss =    0 h 49 m 04 s
 Estimated total run time in seconds =    3091.14671860710     
 Estimated total run time in hh:mm:ss =    0 h 51 m 31 s
 We have done    4.728132     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         2500
 Time:    5.880125      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.0011740E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.1290762E-19
 Max of strain, eps_trace_over_3_crust_mantle =  4.6551027E-14
 Max of strain, epsilondev_crust_mantle  =  2.3625422E-09
 Elapsed time in seconds =    182.502222629000     
 Elapsed time in hh:mm:ss =    0 h 03 m 02 s
 Mean elapsed time per time step in seconds =   7.300088905160000E-002
 Time steps done =         2500  out of        42300
 Time steps remaining =        39800
 Estimated remaining time in seconds =    2905.43538425368     
 Estimated remaining time in hh:mm:ss =    0 h 48 m 25 s
 Estimated total run time in seconds =    3087.93760688268     
 Estimated total run time in hh:mm:ss =    0 h 51 m 27 s
 We have done    5.910165     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         3000
 Time:    7.067625      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.1221928E-04
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    8.2992654E-19
 Max of strain, eps_trace_over_3_crust_mantle =  1.7395258E-13
 Max of strain, epsilondev_crust_mantle  =  2.3083722E-08
 Elapsed time in seconds =    219.120321096000     
 Elapsed time in hh:mm:ss =    0 h 03 m 39 s
 Mean elapsed time per time step in seconds =   7.304010703199999E-002
 Time steps done =         3000  out of        42300
 Time steps remaining =        39300
 Estimated remaining time in seconds =    2870.47620635760     
 Estimated remaining time in hh:mm:ss =    0 h 47 m 50 s
 Estimated total run time in seconds =    3089.59652745360     
 Estimated total run time in hh:mm:ss =    0 h 51 m 29 s
 We have done    7.092198     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         3500
 Time:    8.255125      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.6535454E-04
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.4149290E-18
 Max of strain, eps_trace_over_3_crust_mantle =  4.1962611E-13
 Max of strain, epsilondev_crust_mantle  =  1.1850609E-07
 Elapsed time in seconds =    256.164270233000     
 Elapsed time in hh:mm:ss =    0 h 04 m 16 s
 Mean elapsed time per time step in seconds =   7.318979149514286E-002
 Time steps done =         3500  out of        42300
 Time steps remaining =        38800
 Estimated remaining time in seconds =    2839.76391001154     
 Estimated remaining time in hh:mm:ss =    0 h 47 m 19 s
 Estimated total run time in seconds =    3095.92818024454     
 Estimated total run time in hh:mm:ss =    0 h 51 m 35 s
 We have done    8.274232     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         4000
 Time:    9.442625      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.4405496E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.3770961E-18
 Max of strain, eps_trace_over_3_crust_mantle =  1.8768108E-12
 Max of strain, epsilondev_crust_mantle  =  1.1862168E-08
 Elapsed time in seconds =    293.043588453000     
 Elapsed time in hh:mm:ss =    0 h 04 m 53 s
 Mean elapsed time per time step in seconds =   7.326089711325001E-002
 Time steps done =         4000  out of        42300
 Time steps remaining =        38300
 Estimated remaining time in seconds =    2805.89235943748     
 Estimated remaining time in hh:mm:ss =    0 h 46 m 45 s
 Estimated total run time in seconds =    3098.93594789048     
 Estimated total run time in hh:mm:ss =    0 h 51 m 38 s
 We have done    9.456264     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         4500
 Time:    10.63013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.8094392E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.6682251E-18
 Max of strain, eps_trace_over_3_crust_mantle =  4.3998347E-12
 Max of strain, epsilondev_crust_mantle  =  4.2666564E-09
 Elapsed time in seconds =    329.814910563000     
 Elapsed time in hh:mm:ss =    0 h 05 m 29 s
 Mean elapsed time per time step in seconds =   7.329220234733333E-002
 Time steps done =         4500  out of        42300
 Time steps remaining =        37800
 Estimated remaining time in seconds =    2770.44524872920     
 Estimated remaining time in hh:mm:ss =    0 h 46 m 10 s
 Estimated total run time in seconds =    3100.26015929220     
 Estimated total run time in hh:mm:ss =    0 h 51 m 40 s
 We have done    10.63830     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         5000
 Time:    11.81763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.1362122E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.2301382E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.6144425E-12
 Max of strain, epsilondev_crust_mantle  =  2.2771109E-09
 Elapsed time in seconds =    366.454564301000     
 Elapsed time in hh:mm:ss =    0 h 06 m 06 s
 Mean elapsed time per time step in seconds =   7.329091286019999E-002
 Time steps done =         5000  out of        42300
 Time steps remaining =        37300
 Estimated remaining time in seconds =    2733.75104968546     
 Estimated remaining time in hh:mm:ss =    0 h 45 m 33 s
 Estimated total run time in seconds =    3100.20561398646     
 Estimated total run time in hh:mm:ss =    0 h 51 m 40 s
 We have done    11.82033     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         5500
 Time:    13.00513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.2822634E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.6926165E-17
 Max of strain, eps_trace_over_3_crust_mantle =  8.1465303E-13
 Max of strain, epsilondev_crust_mantle  =  2.7653835E-09
 Elapsed time in seconds =    402.917868247000     
 Elapsed time in hh:mm:ss =    0 h 06 m 42 s
 Mean elapsed time per time step in seconds =   7.325779422672728E-002
 Time steps done =         5500  out of        42300
 Time steps remaining =        36800
 Estimated remaining time in seconds =    2695.88682754356     
 Estimated remaining time in hh:mm:ss =    0 h 44 m 55 s
 Estimated total run time in seconds =    3098.80469579056     
 Estimated total run time in hh:mm:ss =    0 h 51 m 38 s
 We have done    13.00236     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         6000
 Time:    14.19263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.3159980E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.2988501E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.7217368E-13
 Max of strain, epsilondev_crust_mantle  =  2.8402269E-09
 Elapsed time in seconds =    439.457829917000     
 Elapsed time in hh:mm:ss =    0 h 07 m 19 s
 Mean elapsed time per time step in seconds =   7.324297165283333E-002
 Time steps done =         6000  out of        42300
 Time steps remaining =        36300
 Estimated remaining time in seconds =    2658.71987099785     
 Estimated remaining time in hh:mm:ss =    0 h 44 m 18 s
 Estimated total run time in seconds =    3098.17770091485     
 Estimated total run time in hh:mm:ss =    0 h 51 m 38 s
 We have done    14.18440     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         6500
 Time:    15.38013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2946039E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5370349E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.0632005E-12
 Max of strain, epsilondev_crust_mantle  =  7.1972528E-10
 Elapsed time in seconds =    476.095884525000     
 Elapsed time in hh:mm:ss =    0 h 07 m 56 s
 Mean elapsed time per time step in seconds =   7.324552069615385E-002
 Time steps done =         6500  out of        42300
 Time steps remaining =        35800
 Estimated remaining time in seconds =    2622.18964092231     
 Estimated remaining time in hh:mm:ss =    0 h 43 m 42 s
 Estimated total run time in seconds =    3098.28552544731     
 Estimated total run time in hh:mm:ss =    0 h 51 m 38 s
 We have done    15.36643     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         7000
 Time:    16.56763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.8134533E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.3793194E-16
 Max of strain, eps_trace_over_3_crust_mantle =  3.1478028E-12
 Max of strain, epsilondev_crust_mantle  =  1.2607415E-09
 Elapsed time in seconds =    513.132110204000     
 Elapsed time in hh:mm:ss =    0 h 08 m 33 s
 Mean elapsed time per time step in seconds =   7.330458717200000E-002
 Time steps done =         7000  out of        42300
 Time steps remaining =        35300
 Estimated remaining time in seconds =    2587.65192717160     
 Estimated remaining time in hh:mm:ss =    0 h 43 m 07 s
 Estimated total run time in seconds =    3100.78403737560     
 Estimated total run time in hh:mm:ss =    0 h 51 m 40 s
 We have done    16.54846     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         7500
 Time:    17.75513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  7.9136917E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.5912357E-16
 Max of strain, eps_trace_over_3_crust_mantle =  1.9534257E-12
 Max of strain, epsilondev_crust_mantle  =  1.7139654E-09
 Elapsed time in seconds =    550.067548061000     
 Elapsed time in hh:mm:ss =    0 h 09 m 10 s
 Mean elapsed time per time step in seconds =   7.334233974146667E-002
 Time steps done =         7500  out of        42300
 Time steps remaining =        34800
 Estimated remaining time in seconds =    2552.31342300304     
 Estimated remaining time in hh:mm:ss =    0 h 42 m 32 s
 Estimated total run time in seconds =    3102.38097106404     
 Estimated total run time in hh:mm:ss =    0 h 51 m 42 s
 We have done    17.73050     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         8000
 Time:    18.94263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6492860E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.2043661E-16
 Max of strain, eps_trace_over_3_crust_mantle =  1.9249324E-12
 Max of strain, epsilondev_crust_mantle  =  5.7978844E-10
 Elapsed time in seconds =    587.114871988000     
 Elapsed time in hh:mm:ss =    0 h 09 m 47 s
 Mean elapsed time per time step in seconds =   7.338935899850001E-002
 Time steps done =         8000  out of        42300
 Time steps remaining =        34300
 Estimated remaining time in seconds =    2517.25501364855     
 Estimated remaining time in hh:mm:ss =    0 h 41 m 57 s
 Estimated total run time in seconds =    3104.36988563655     
 Estimated total run time in hh:mm:ss =    0 h 51 m 44 s
 We have done    18.91253     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         8500
 Time:    20.13013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2534558E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.3672510E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.4109853E-12
 Max of strain, epsilondev_crust_mantle  =  7.0232797E-10
 Elapsed time in seconds =    624.163628571000     
 Elapsed time in hh:mm:ss =    0 h 10 m 24 s
 Mean elapsed time per time step in seconds =   7.343101512600000E-002
 Time steps done =         8500  out of        42300
 Time steps remaining =        33800
 Estimated remaining time in seconds =    2481.96831125880     
 Estimated remaining time in hh:mm:ss =    0 h 41 m 21 s
 Estimated total run time in seconds =    3106.13193982980     
 Estimated total run time in hh:mm:ss =    0 h 51 m 46 s
 We have done    20.09456     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #         9000
 Time:    21.31763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.2392656E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.4841810E-17
 Max of strain, eps_trace_over_3_crust_mantle =  9.7787197E-13
 Max of strain, epsilondev_crust_mantle  =  1.1423210E-09
 Elapsed time in seconds =    661.026267775000     
 Elapsed time in hh:mm:ss =    0 h 11 m 01 s
 Mean elapsed time per time step in seconds =   7.344736308611112E-002
 Time steps done =         9000  out of        42300
 Time steps remaining =        33300
 Estimated remaining time in seconds =    2445.79719076750     
 Estimated remaining time in hh:mm:ss =    0 h 40 m 45 s
 Estimated total run time in seconds =    3106.82345854250     
 Estimated total run time in hh:mm:ss =    0 h 51 m 46 s
 We have done    21.27660     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #         9500
 Time:    22.50513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4036840E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.0619232E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.3140704E-12
 Max of strain, epsilondev_crust_mantle  =  5.2206739E-10
 Elapsed time in seconds =    697.729605097000     
 Elapsed time in hh:mm:ss =    0 h 11 m 37 s
 Mean elapsed time per time step in seconds =   7.344522158915789E-002
 Time steps done =         9500  out of        42300
 Time steps remaining =        32800
 Estimated remaining time in seconds =    2409.00326812438     
 Estimated remaining time in hh:mm:ss =    0 h 40 m 09 s
 Estimated total run time in seconds =    3106.73287322138     
 Estimated total run time in hh:mm:ss =    0 h 51 m 46 s
 We have done    22.45863     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        10000
 Time:    23.69263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.8727020E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.7488915E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.1940976E-12
 Max of strain, epsilondev_crust_mantle  =  4.0450041E-10
 Elapsed time in seconds =    734.568142486000     
 Elapsed time in hh:mm:ss =    0 h 12 m 14 s
 Mean elapsed time per time step in seconds =   7.345681424860001E-002
 Time steps done =        10000  out of        42300
 Time steps remaining =        32300
 Estimated remaining time in seconds =    2372.65510022978     
 Estimated remaining time in hh:mm:ss =    0 h 39 m 32 s
 Estimated total run time in seconds =    3107.22324271578     
 Estimated total run time in hh:mm:ss =    0 h 51 m 47 s
 We have done    23.64066     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        10500
 Time:    24.88013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6587762E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.3235521E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.6909181E-12
 Max of strain, epsilondev_crust_mantle  =  8.0147522E-10
 Elapsed time in seconds =    771.553491494000     
 Elapsed time in hh:mm:ss =    0 h 12 m 51 s
 Mean elapsed time per time step in seconds =   7.348128490419048E-002
 Time steps done =        10500  out of        42300
 Time steps remaining =        31800
 Estimated remaining time in seconds =    2336.70485995326     
 Estimated remaining time in hh:mm:ss =    0 h 38 m 56 s
 Estimated total run time in seconds =    3108.25835144726     
 Estimated total run time in hh:mm:ss =    0 h 51 m 48 s
 We have done    24.82269     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        11000
 Time:    26.06763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.1049223E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.5511386E-17
 Max of strain, eps_trace_over_3_crust_mantle =  7.1230673E-13
 Max of strain, epsilondev_crust_mantle  =  4.5692070E-10
 Elapsed time in seconds =    808.449720981000     
 Elapsed time in hh:mm:ss =    0 h 13 m 28 s
 Mean elapsed time per time step in seconds =   7.349542918009092E-002
 Time steps done =        11000  out of        42300
 Time steps remaining =        31300
 Estimated remaining time in seconds =    2300.40693333685     
 Estimated remaining time in hh:mm:ss =    0 h 38 m 20 s
 Estimated total run time in seconds =    3108.85665431785     
 Estimated total run time in hh:mm:ss =    0 h 51 m 48 s
 We have done    26.00473     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        11500
 Time:    27.25513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.0043776E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.5657338E-17
 Max of strain, eps_trace_over_3_crust_mantle =  7.4203393E-13
 Max of strain, epsilondev_crust_mantle  =  2.1927693E-10
 Elapsed time in seconds =    845.488200744000     
 Elapsed time in hh:mm:ss =    0 h 14 m 05 s
 Mean elapsed time per time step in seconds =   7.352071310817392E-002
 Time steps done =        11500  out of        42300
 Time steps remaining =        30800
 Estimated remaining time in seconds =    2264.43796373176     
 Estimated remaining time in hh:mm:ss =    0 h 37 m 44 s
 Estimated total run time in seconds =    3109.92616447576     
 Estimated total run time in hh:mm:ss =    0 h 51 m 49 s
 We have done    27.18676     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        12000
 Time:    28.44263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6512180E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.0719129E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.3601458E-12
 Max of strain, epsilondev_crust_mantle  =  5.7597482E-10
 Elapsed time in seconds =    882.273726645000     
 Elapsed time in hh:mm:ss =    0 h 14 m 42 s
 Mean elapsed time per time step in seconds =   7.352281055375000E-002
 Time steps done =        12000  out of        42300
 Time steps remaining =        30300
 Estimated remaining time in seconds =    2227.74115977862     
 Estimated remaining time in hh:mm:ss =    0 h 37 m 07 s
 Estimated total run time in seconds =    3110.01488642362     
 Estimated total run time in hh:mm:ss =    0 h 51 m 50 s
 We have done    28.36879     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        12500
 Time:    29.63013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.7608145E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5777754E-17
 Max of strain, eps_trace_over_3_crust_mantle =  7.7615106E-13
 Max of strain, epsilondev_crust_mantle  =  3.8331371E-10
 Elapsed time in seconds =    918.975093210000     
 Elapsed time in hh:mm:ss =    0 h 15 m 18 s
 Mean elapsed time per time step in seconds =   7.351800745680001E-002
 Time steps done =        12500  out of        42300
 Time steps remaining =        29800
 Estimated remaining time in seconds =    2190.83662221264     
 Estimated remaining time in hh:mm:ss =    0 h 36 m 30 s
 Estimated total run time in seconds =    3109.81171542264     
 Estimated total run time in hh:mm:ss =    0 h 51 m 49 s
 We have done    29.55083     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        13000
 Time:    30.81763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  7.4092281E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.8862529E-17
 Max of strain, eps_trace_over_3_crust_mantle =  6.0927240E-13
 Max of strain, epsilondev_crust_mantle  =  1.0197551E-10
 Elapsed time in seconds =    955.898178196000     
 Elapsed time in hh:mm:ss =    0 h 15 m 55 s
 Mean elapsed time per time step in seconds =   7.353062909200000E-002
 Time steps done =        13000  out of        42300
 Time steps remaining =        29300
 Estimated remaining time in seconds =    2154.44743239560     
 Estimated remaining time in hh:mm:ss =    0 h 35 m 54 s
 Estimated total run time in seconds =    3110.34561059160     
 Estimated total run time in hh:mm:ss =    0 h 51 m 50 s
 We have done    30.73286     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        13500
 Time:    32.00512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.8973550E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.3452673E-17
 Max of strain, eps_trace_over_3_crust_mantle =  8.7990542E-13
 Max of strain, epsilondev_crust_mantle  =  4.1162562E-10
 Elapsed time in seconds =    992.889583384000     
 Elapsed time in hh:mm:ss =    0 h 16 m 32 s
 Mean elapsed time per time step in seconds =   7.354737654696297E-002
 Time steps done =        13500  out of        42300
 Time steps remaining =        28800
 Estimated remaining time in seconds =    2118.16444455253     
 Estimated remaining time in hh:mm:ss =    0 h 35 m 18 s
 Estimated total run time in seconds =    3111.05402793653     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    31.91489     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        14000
 Time:    33.19262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.4273070E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.6076114E-17
 Max of strain, eps_trace_over_3_crust_mantle =  8.3054977E-13
 Max of strain, epsilondev_crust_mantle  =  3.1056813E-10
 Elapsed time in seconds =    1029.79242984700     
 Elapsed time in hh:mm:ss =    0 h 17 m 09 s
 Mean elapsed time per time step in seconds =   7.355660213192858E-002
 Time steps done =        14000  out of        42300
 Time steps remaining =        28300
 Estimated remaining time in seconds =    2081.65184033358     
 Estimated remaining time in hh:mm:ss =    0 h 34 m 41 s
 Estimated total run time in seconds =    3111.44427018058     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    33.09693     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        14500
 Time:    34.38012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  8.3998293E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.5303262E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.0462871E-12
 Max of strain, epsilondev_crust_mantle  =  3.2445456E-11
 Elapsed time in seconds =    1066.45335769300     
 Elapsed time in hh:mm:ss =    0 h 17 m 46 s
 Mean elapsed time per time step in seconds =   7.354850742710345E-002
 Time steps done =        14500  out of        42300
 Time steps remaining =        27800
 Estimated remaining time in seconds =    2044.64850647348     
 Estimated remaining time in hh:mm:ss =    0 h 34 m 04 s
 Estimated total run time in seconds =    3111.10186416648     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    34.27896     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        15000
 Time:    35.56762      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.3106162E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.1605406E-17
 Max of strain, eps_trace_over_3_crust_mantle =  8.6905776E-13
 Max of strain, epsilondev_crust_mantle  =  2.8486721E-10
 Elapsed time in seconds =    1103.21002804400     
 Elapsed time in hh:mm:ss =    0 h 18 m 23 s
 Mean elapsed time per time step in seconds =   7.354733520293333E-002
 Time steps done =        15000  out of        42300
 Time steps remaining =        27300
 Estimated remaining time in seconds =    2007.84225104008     
 Estimated remaining time in hh:mm:ss =    0 h 33 m 27 s
 Estimated total run time in seconds =    3111.05227908408     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    35.46099     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        15500
 Time:    36.75512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.1232100E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.3971586E-17
 Max of strain, eps_trace_over_3_crust_mantle =  6.0747604E-13
 Max of strain, epsilondev_crust_mantle  =  2.4305846E-10
 Elapsed time in seconds =    1139.90531306300     
 Elapsed time in hh:mm:ss =    0 h 18 m 59 s
 Mean elapsed time per time step in seconds =   7.354227826212903E-002
 Time steps done =        15500  out of        42300
 Time steps remaining =        26800
 Estimated remaining time in seconds =    1970.93305742506     
 Estimated remaining time in hh:mm:ss =    0 h 32 m 50 s
 Estimated total run time in seconds =    3110.83837048806     
 Estimated total run time in hh:mm:ss =    0 h 51 m 50 s
 We have done    36.64302     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        16000
 Time:    37.94262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.0356799E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.2294704E-17
 Max of strain, eps_trace_over_3_crust_mantle =  5.9478464E-13
 Max of strain, epsilondev_crust_mantle  =  1.0590069E-11
 Elapsed time in seconds =    1176.59431482300     
 Elapsed time in hh:mm:ss =    0 h 19 m 36 s
 Mean elapsed time per time step in seconds =   7.353714467643750E-002
 Time steps done =        16000  out of        42300
 Time steps remaining =        26300
 Estimated remaining time in seconds =    1934.02690499031     
 Estimated remaining time in hh:mm:ss =    0 h 32 m 14 s
 Estimated total run time in seconds =    3110.62121981331     
 Estimated total run time in hh:mm:ss =    0 h 51 m 50 s
 We have done    37.82506     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        16500
 Time:    39.13012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  8.7242665E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.3339918E-17
 Max of strain, eps_trace_over_3_crust_mantle =  5.5509975E-13
 Max of strain, epsilondev_crust_mantle  =  1.8719482E-10
 Elapsed time in seconds =    1213.53868007300     
 Elapsed time in hh:mm:ss =    0 h 20 m 13 s
 Mean elapsed time per time step in seconds =   7.354779879230303E-002
 Time steps done =        16500  out of        42300
 Time steps remaining =        25800
 Estimated remaining time in seconds =    1897.53320884142     
 Estimated remaining time in hh:mm:ss =    0 h 31 m 37 s
 Estimated total run time in seconds =    3111.07188891442     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    39.00709     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        17000
 Time:    40.31762      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  8.3093755E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.6839531E-17
 Max of strain, eps_trace_over_3_crust_mantle =  8.2580991E-13
 Max of strain, epsilondev_crust_mantle  =  1.8174275E-10
 Elapsed time in seconds =    1250.40241818200     
 Elapsed time in hh:mm:ss =    0 h 20 m 50 s
 Mean elapsed time per time step in seconds =   7.355308342247059E-002
 Time steps done =        17000  out of        42300
 Time steps remaining =        25300
 Estimated remaining time in seconds =    1860.89301058851     
 Estimated remaining time in hh:mm:ss =    0 h 31 m 00 s
 Estimated total run time in seconds =    3111.29542877051     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    40.18913     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        17500
 Time:    41.50512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.8685731E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    8.3979161E-17
 Max of strain, eps_trace_over_3_crust_mantle =  5.7751839E-13
 Max of strain, epsilondev_crust_mantle  =  2.3585816E-11
 Elapsed time in seconds =    1287.46803693500     
 Elapsed time in hh:mm:ss =    0 h 21 m 27 s
 Mean elapsed time per time step in seconds =   7.356960211057144E-002
 Time steps done =        17500  out of        42300
 Time steps remaining =        24800
 Estimated remaining time in seconds =    1824.52613234217     
 Estimated remaining time in hh:mm:ss =    0 h 30 m 24 s
 Estimated total run time in seconds =    3111.99416927717     
 Estimated total run time in hh:mm:ss =    0 h 51 m 51 s
 We have done    41.37116     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        18000
 Time:    42.69262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.7510033E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.6162430E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.8325731E-13
 Max of strain, epsilondev_crust_mantle  =  1.1587098E-10
 Elapsed time in seconds =    1324.36373162000     
 Elapsed time in hh:mm:ss =    0 h 22 m 04 s
 Mean elapsed time per time step in seconds =   7.357576286777777E-002
 Time steps done =        18000  out of        42300
 Time steps remaining =        24300
 Estimated remaining time in seconds =    1787.89103768700     
 Estimated remaining time in hh:mm:ss =    0 h 29 m 47 s
 Estimated total run time in seconds =    3112.25476930700     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    42.55319     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        18500
 Time:    43.88012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.8074039E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.3284134E-17
 Max of strain, eps_trace_over_3_crust_mantle =  6.2006281E-13
 Max of strain, epsilondev_crust_mantle  =  1.2679681E-10
 Elapsed time in seconds =    1361.21091329700     
 Elapsed time in hh:mm:ss =    0 h 22 m 41 s
 Mean elapsed time per time step in seconds =   7.357896828632432E-002
 Time steps done =        18500  out of        42300
 Time steps remaining =        23800
 Estimated remaining time in seconds =    1751.17944521452     
 Estimated remaining time in hh:mm:ss =    0 h 29 m 11 s
 Estimated total run time in seconds =    3112.39035851152     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    43.73523     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        19000
 Time:    45.06762      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.4872095E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.3726660E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.7721999E-13
 Max of strain, epsilondev_crust_mantle  =  2.9232766E-11
 Elapsed time in seconds =    1398.13676107000     
 Elapsed time in hh:mm:ss =    0 h 23 m 18 s
 Mean elapsed time per time step in seconds =   7.358614531947368E-002
 Time steps done =        19000  out of        42300
 Time steps remaining =        23300
 Estimated remaining time in seconds =    1714.55718594374     
 Estimated remaining time in hh:mm:ss =    0 h 28 m 34 s
 Estimated total run time in seconds =    3112.69394701374     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    44.91726     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        19500
 Time:    46.25512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.2057101E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.3058832E-17
 Max of strain, eps_trace_over_3_crust_mantle =  6.1128750E-13
 Max of strain, epsilondev_crust_mantle  =  6.5883278E-11
 Elapsed time in seconds =    1435.27974628700     
 Elapsed time in hh:mm:ss =    0 h 23 m 55 s
 Mean elapsed time per time step in seconds =   7.360408955317949E-002
 Time steps done =        19500  out of        42300
 Time steps remaining =        22800
 Estimated remaining time in seconds =    1678.17324181249     
 Estimated remaining time in hh:mm:ss =    0 h 27 m 58 s
 Estimated total run time in seconds =    3113.45298809949     
 Estimated total run time in hh:mm:ss =    0 h 51 m 53 s
 We have done    46.09929     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        20000
 Time:    47.44262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  4.6778055E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.9487689E-17
 Max of strain, eps_trace_over_3_crust_mantle =  5.5630717E-13
 Max of strain, epsilondev_crust_mantle  =  8.0541761E-11
 Elapsed time in seconds =    1472.41774544500     
 Elapsed time in hh:mm:ss =    0 h 24 m 32 s
 Mean elapsed time per time step in seconds =   7.362088727225000E-002
 Time steps done =        20000  out of        42300
 Time steps remaining =        22300
 Estimated remaining time in seconds =    1641.74578617117     
 Estimated remaining time in hh:mm:ss =    0 h 27 m 21 s
 Estimated total run time in seconds =    3114.16353161617     
 Estimated total run time in hh:mm:ss =    0 h 51 m 54 s
 We have done    47.28132     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        20500
 Time:    48.63012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.7860795E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.6167236E-17
 Max of strain, eps_trace_over_3_crust_mantle =  5.7777069E-13
 Max of strain, epsilondev_crust_mantle  =  2.5953994E-11
 Elapsed time in seconds =    1509.01033362300     
 Elapsed time in hh:mm:ss =    0 h 25 m 09 s
 Mean elapsed time per time step in seconds =   7.361026017673171E-002
 Time steps done =        20500  out of        42300
 Time steps remaining =        21800
 Estimated remaining time in seconds =    1604.70367185275     
 Estimated remaining time in hh:mm:ss =    0 h 26 m 44 s
 Estimated total run time in seconds =    3113.71400547575     
 Estimated total run time in hh:mm:ss =    0 h 51 m 53 s
 We have done    48.46336     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        21000
 Time:    49.81762      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.5080637E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.0822266E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.6400451E-13
 Max of strain, epsilondev_crust_mantle  =  3.2688015E-11
 Elapsed time in seconds =    1545.50366977800     
 Elapsed time in hh:mm:ss =    0 h 25 m 45 s
 Mean elapsed time per time step in seconds =   7.359541284657144E-002
 Time steps done =        21000  out of        42300
 Time steps remaining =        21300
 Estimated remaining time in seconds =    1567.58229363197     
 Estimated remaining time in hh:mm:ss =    0 h 26 m 07 s
 Estimated total run time in seconds =    3113.08596340997     
 Estimated total run time in hh:mm:ss =    0 h 51 m 53 s
 We have done    49.64539     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        21500
 Time:    51.00512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.3892999E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.8066167E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.9071334E-13
 Max of strain, epsilondev_crust_mantle  =  4.3958979E-11
 Elapsed time in seconds =    1581.90282175700     
 Elapsed time in hh:mm:ss =    0 h 26 m 21 s
 Mean elapsed time per time step in seconds =   7.357687543055814E-002
 Time steps done =        21500  out of        42300
 Time steps remaining =        20800
 Estimated remaining time in seconds =    1530.39900895561     
 Estimated remaining time in hh:mm:ss =    0 h 25 m 30 s
 Estimated total run time in seconds =    3112.30183071261     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    50.82742     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        22000
 Time:    52.19262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.5017811E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.4870510E-16
 Max of strain, eps_trace_over_3_crust_mantle =  5.0591828E-13
 Max of strain, epsilondev_crust_mantle  =  1.6786494E-11
 Elapsed time in seconds =    1618.59889947300     
 Elapsed time in hh:mm:ss =    0 h 26 m 58 s
 Mean elapsed time per time step in seconds =   7.357267724877273E-002
 Time steps done =        22000  out of        42300
 Time steps remaining =        20300
 Estimated remaining time in seconds =    1493.52534815009     
 Estimated remaining time in hh:mm:ss =    0 h 24 m 53 s
 Estimated total run time in seconds =    3112.12424762309     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    52.00946     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        22500
 Time:    53.38012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.5630237E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.1465796E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.7599383E-13
 Max of strain, epsilondev_crust_mantle  =  1.2025422E-11
 Elapsed time in seconds =    1655.48486593500     
 Elapsed time in hh:mm:ss =    0 h 27 m 35 s
 Mean elapsed time per time step in seconds =   7.357710515266666E-002
 Time steps done =        22500  out of        42300
 Time steps remaining =        19800
 Estimated remaining time in seconds =    1456.82668202280     
 Estimated remaining time in hh:mm:ss =    0 h 24 m 16 s
 Estimated total run time in seconds =    3112.31154795780     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    53.19149     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        23000
 Time:    54.56762      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.4252679E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.5720173E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.5967104E-13
 Max of strain, epsilondev_crust_mantle  =  1.6726575E-11
 Elapsed time in seconds =    1692.47114139600     
 Elapsed time in hh:mm:ss =    0 h 28 m 12 s
 Mean elapsed time per time step in seconds =   7.358570179982610E-002
 Time steps done =        23000  out of        42300
 Time steps remaining =        19300
 Estimated remaining time in seconds =    1420.20404473664     
 Estimated remaining time in hh:mm:ss =    0 h 23 m 40 s
 Estimated total run time in seconds =    3112.67518613264     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    54.37352     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        23500
 Time:    55.75512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2567226E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.5076147E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.3966187E-13
 Max of strain, epsilondev_crust_mantle  =  5.2981976E-12
 Elapsed time in seconds =    1729.17932104600     
 Elapsed time in hh:mm:ss =    0 h 28 m 49 s
 Mean elapsed time per time step in seconds =   7.358209876791490E-002
 Time steps done =        23500  out of        42300
 Time steps remaining =        18800
 Estimated remaining time in seconds =    1383.34345683680     
 Estimated remaining time in hh:mm:ss =    0 h 23 m 03 s
 Estimated total run time in seconds =    3112.52277788280     
 Estimated total run time in hh:mm:ss =    0 h 51 m 52 s
 We have done    55.55556     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        24000
 Time:    56.94262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.8546475E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.0684175E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.3145242E-13
 Max of strain, epsilondev_crust_mantle  =  3.2568679E-12
 Elapsed time in seconds =    1766.28734656500     
 Elapsed time in hh:mm:ss =    0 h 29 m 26 s
 Mean elapsed time per time step in seconds =   7.359530610687499E-002
 Time steps done =        24000  out of        42300
 Time steps remaining =        18300
 Estimated remaining time in seconds =    1346.79410175581     
 Estimated remaining time in hh:mm:ss =    0 h 22 m 26 s
 Estimated total run time in seconds =    3113.08144832081     
 Estimated total run time in hh:mm:ss =    0 h 51 m 53 s
 We have done    56.73759     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        24500
 Time:    58.13012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5536355E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.9286695E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.2210235E-13
 Max of strain, epsilondev_crust_mantle  =  2.8245436E-12
 Elapsed time in seconds =    1803.46838185800     
 Elapsed time in hh:mm:ss =    0 h 30 m 03 s
 Mean elapsed time per time step in seconds =   7.361095436155102E-002
 Time steps done =        24500  out of        42300
 Time steps remaining =        17800
 Estimated remaining time in seconds =    1310.27498763561     
 Estimated remaining time in hh:mm:ss =    0 h 21 m 50 s
 Estimated total run time in seconds =    3113.74336949361     
 Estimated total run time in hh:mm:ss =    0 h 51 m 53 s
 We have done    57.91962     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        25000
 Time:    59.31762      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4020073E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.0132266E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.8518250E-13
 Max of strain, epsilondev_crust_mantle  =  5.5135792E-12
 Elapsed time in seconds =    1840.49491507300     
 Elapsed time in hh:mm:ss =    0 h 30 m 40 s
 Mean elapsed time per time step in seconds =   7.361979660292001E-002
 Time steps done =        25000  out of        42300
 Time steps remaining =        17300
 Estimated remaining time in seconds =    1273.62248123052     
 Estimated remaining time in hh:mm:ss =    0 h 21 m 13 s
 Estimated total run time in seconds =    3114.11739630352     
 Estimated total run time in hh:mm:ss =    0 h 51 m 54 s
 We have done    59.10165     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        25500
 Time:    60.50512      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.0299339E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.4451897E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.3347387E-13
 Max of strain, epsilondev_crust_mantle  =  2.8225226E-12
 Elapsed time in seconds =    1877.25176986800     
 Elapsed time in hh:mm:ss =    0 h 31 m 17 s
 Mean elapsed time per time step in seconds =   7.361771646541176E-002
 Time steps done =        25500  out of        42300
 Time steps remaining =        16800
 Estimated remaining time in seconds =    1236.77763661892     
 Estimated remaining time in hh:mm:ss =    0 h 20 m 36 s
 Estimated total run time in seconds =    3114.02940648692     
 Estimated total run time in hh:mm:ss =    0 h 51 m 54 s
 We have done    60.28369     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        26000
 Time:    61.69262      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.9092771E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.3872498E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.9827036E-13
 Max of strain, epsilondev_crust_mantle  =  1.4440783E-11
 Elapsed time in seconds =    1914.45293684300     
 Elapsed time in hh:mm:ss =    0 h 31 m 54 s
 Mean elapsed time per time step in seconds =   7.363280526319231E-002
 Time steps done =        26000  out of        42300
 Time steps remaining =        16300
 Estimated remaining time in seconds =    1200.21472579003     
 Estimated remaining time in hh:mm:ss =    0 h 20 m 00 s
 Estimated total run time in seconds =    3114.66766263303     
 Estimated total run time in hh:mm:ss =    0 h 51 m 54 s
 We have done    61.46572     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        26500
 Time:    62.88012      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.7327300E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.9250976E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.8027749E-13
 Max of strain, epsilondev_crust_mantle  =  1.4039441E-11
 Elapsed time in seconds =    1951.66428200900     
 Elapsed time in hh:mm:ss =    0 h 32 m 31 s
 Mean elapsed time per time step in seconds =   7.364770875505661E-002
 Time steps done =        26500  out of        42300
 Time steps remaining =        15800
 Estimated remaining time in seconds =    1163.63379832989     
 Estimated remaining time in hh:mm:ss =    0 h 19 m 23 s
 Estimated total run time in seconds =    3115.29808033889     
 Estimated total run time in hh:mm:ss =    0 h 51 m 55 s
 We have done    62.64775     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        27000
 Time:    64.06763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.8427962E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.7717588E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.9502828E-13
 Max of strain, epsilondev_crust_mantle  =  3.3268087E-12
 Elapsed time in seconds =    1988.61948499400     
 Elapsed time in hh:mm:ss =    0 h 33 m 08 s
 Mean elapsed time per time step in seconds =   7.365257351829629E-002
 Time steps done =        27000  out of        42300
 Time steps remaining =        15300
 Estimated remaining time in seconds =    1126.88437482993     
 Estimated remaining time in hh:mm:ss =    0 h 18 m 46 s
 Estimated total run time in seconds =    3115.50385982393     
 Estimated total run time in hh:mm:ss =    0 h 51 m 55 s
 We have done    63.82979     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        27500
 Time:    65.25513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2690028E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    8.7448701E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.8753107E-13
 Max of strain, epsilondev_crust_mantle  =  2.0281089E-11
 Elapsed time in seconds =    2025.61065253700     
 Elapsed time in hh:mm:ss =    0 h 33 m 45 s
 Mean elapsed time per time step in seconds =   7.365856918316364E-002
 Time steps done =        27500  out of        42300
 Time steps remaining =        14800
 Estimated remaining time in seconds =    1090.14682391082     
 Estimated remaining time in hh:mm:ss =    0 h 18 m 10 s
 Estimated total run time in seconds =    3115.75747644782     
 Estimated total run time in hh:mm:ss =    0 h 51 m 55 s
 We have done    65.01182     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        28000
 Time:    66.44263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.3367465E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.2574912E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.7508039E-13
 Max of strain, epsilondev_crust_mantle  =  1.9504584E-11
 Elapsed time in seconds =    2062.72636228900     
 Elapsed time in hh:mm:ss =    0 h 34 m 22 s
 Mean elapsed time per time step in seconds =   7.366879865317857E-002
 Time steps done =        28000  out of        42300
 Time steps remaining =        14300
 Estimated remaining time in seconds =    1053.46382074045     
 Estimated remaining time in hh:mm:ss =    0 h 17 m 33 s
 Estimated total run time in seconds =    3116.19018302945     
 Estimated total run time in hh:mm:ss =    0 h 51 m 56 s
 We have done    66.19386     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        28500
 Time:    67.63013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.7887290E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.0707235E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.5344319E-13
 Max of strain, epsilondev_crust_mantle  =  3.5191004E-12
 Elapsed time in seconds =    2099.60851468100     
 Elapsed time in hh:mm:ss =    0 h 34 m 59 s
 Mean elapsed time per time step in seconds =   7.367047419933334E-002
 Time steps done =        28500  out of        42300
 Time steps remaining =        13800
 Estimated remaining time in seconds =    1016.65254395080     
 Estimated remaining time in hh:mm:ss =    0 h 16 m 56 s
 Estimated total run time in seconds =    3116.26105863180     
 Estimated total run time in hh:mm:ss =    0 h 51 m 56 s
 We have done    67.37589     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        29000
 Time:    68.81763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.1325831E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.1856199E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.5060016E-13
 Max of strain, epsilondev_crust_mantle  =  2.0826165E-11
 Elapsed time in seconds =    2136.75269176100     
 Elapsed time in hh:mm:ss =    0 h 35 m 36 s
 Mean elapsed time per time step in seconds =   7.368112730210344E-002
 Time steps done =        29000  out of        42300
 Time steps remaining =        13300
 Estimated remaining time in seconds =    979.958993117976     
 Estimated remaining time in hh:mm:ss =    0 h 16 m 19 s
 Estimated total run time in seconds =    3116.71168487898     
 Estimated total run time in hh:mm:ss =    0 h 51 m 56 s
 We have done    68.55792     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        29500
 Time:    70.00513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5084051E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9697986E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.4805912E-13
 Max of strain, epsilondev_crust_mantle  =  2.1805285E-11
 Elapsed time in seconds =    2173.91093791000     
 Elapsed time in hh:mm:ss =    0 h 36 m 13 s
 Mean elapsed time per time step in seconds =   7.369189620033899E-002
 Time steps done =        29500  out of        42300
 Time steps remaining =        12800
 Estimated remaining time in seconds =    943.256271364339     
 Estimated remaining time in hh:mm:ss =    0 h 15 m 43 s
 Estimated total run time in seconds =    3117.16720927434     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    69.73995     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        30000
 Time:    71.19263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4669754E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.0580030E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.4661640E-13
 Max of strain, epsilondev_crust_mantle  =  3.4801725E-12
 Elapsed time in seconds =    2211.06965548200     
 Elapsed time in hh:mm:ss =    0 h 36 m 51 s
 Mean elapsed time per time step in seconds =   7.370232184940001E-002
 Time steps done =        30000  out of        42300
 Time steps remaining =        12300
 Estimated remaining time in seconds =    906.538558747620     
 Estimated remaining time in hh:mm:ss =    0 h 15 m 06 s
 Estimated total run time in seconds =    3117.60821422962     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    70.92199     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        30500
 Time:    72.38013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3839861E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.8571429E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.1206553E-13
 Max of strain, epsilondev_crust_mantle  =  1.8062633E-11
 Elapsed time in seconds =    2248.03211301000     
 Elapsed time in hh:mm:ss =    0 h 37 m 28 s
 Mean elapsed time per time step in seconds =   7.370597091836066E-002
 Time steps done =        30500  out of        42300
 Time steps remaining =        11800
 Estimated remaining time in seconds =    869.730456836656     
 Estimated remaining time in hh:mm:ss =    0 h 14 m 29 s
 Estimated total run time in seconds =    3117.76256984666     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    72.10402     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        31000
 Time:    73.56763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3530028E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.1845403E-17
 Max of strain, eps_trace_over_3_crust_mantle =  4.0768978E-13
 Max of strain, epsilondev_crust_mantle  =  2.0699272E-11
 Elapsed time in seconds =    2285.07523422300     
 Elapsed time in hh:mm:ss =    0 h 38 m 05 s
 Mean elapsed time per time step in seconds =   7.371210432977419E-002
 Time steps done =        31000  out of        42300
 Time steps remaining =        11300
 Estimated remaining time in seconds =    832.946778926448     
 Estimated remaining time in hh:mm:ss =    0 h 13 m 52 s
 Estimated total run time in seconds =    3118.02201314945     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    73.28605     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        31500
 Time:    74.75513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4491467E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9283737E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.0031669E-13
 Max of strain, epsilondev_crust_mantle  =  4.5693505E-12
 Elapsed time in seconds =    2322.20406520200     
 Elapsed time in hh:mm:ss =    0 h 38 m 42 s
 Mean elapsed time per time step in seconds =   7.372076397466666E-002
 Time steps done =        31500  out of        42300
 Time steps remaining =        10800
 Estimated remaining time in seconds =    796.184250926400     
 Estimated remaining time in hh:mm:ss =    0 h 13 m 16 s
 Estimated total run time in seconds =    3118.38831612840     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    74.46809     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        32000
 Time:    75.94263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3827951E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.5506762E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.5567857E-13
 Max of strain, epsilondev_crust_mantle  =  1.3326507E-11
 Elapsed time in seconds =    2359.34908759200     
 Elapsed time in hh:mm:ss =    0 h 39 m 19 s
 Mean elapsed time per time step in seconds =   7.372965898725001E-002
 Time steps done =        32000  out of        42300
 Time steps remaining =        10300
 Estimated remaining time in seconds =    759.415487568675     
 Estimated remaining time in hh:mm:ss =    0 h 12 m 39 s
 Estimated total run time in seconds =    3118.76457516068     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    75.65012     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        32500
 Time:    77.13013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4723852E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.1844293E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.3394015E-13
 Max of strain, epsilondev_crust_mantle  =  1.7022253E-11
 Elapsed time in seconds =    2396.30653599200     
 Elapsed time in hh:mm:ss =    0 h 39 m 56 s
 Mean elapsed time per time step in seconds =   7.373250879975385E-002
 Time steps done =        32500  out of        42300
 Time steps remaining =         9800
 Estimated remaining time in seconds =    722.578586237588     
 Estimated remaining time in hh:mm:ss =    0 h 12 m 02 s
 Estimated total run time in seconds =    3118.88512222959     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    76.83215     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        33000
 Time:    78.31763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6036096E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.7319772E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.8275522E-13
 Max of strain, epsilondev_crust_mantle  =  5.1521799E-12
 Elapsed time in seconds =    2433.42217672000     
 Elapsed time in hh:mm:ss =    0 h 40 m 33 s
 Mean elapsed time per time step in seconds =   7.374006596121213E-002
 Time steps done =        33000  out of        42300
 Time steps remaining =         9300
 Estimated remaining time in seconds =    685.782613439273     
 Estimated remaining time in hh:mm:ss =    0 h 11 m 25 s
 Estimated total run time in seconds =    3119.20479015927     
 Estimated total run time in hh:mm:ss =    0 h 51 m 59 s
 We have done    78.01418     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        33500
 Time:    79.50513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.8685429E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5146984E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.1058226E-13
 Max of strain, epsilondev_crust_mantle  =  8.2105095E-12
 Elapsed time in seconds =    2470.18304246400     
 Elapsed time in hh:mm:ss =    0 h 41 m 10 s
 Mean elapsed time per time step in seconds =   7.373680723773135E-002
 Time steps done =        33500  out of        42300
 Time steps remaining =         8800
 Estimated remaining time in seconds =    648.883903692036     
 Estimated remaining time in hh:mm:ss =    0 h 10 m 48 s
 Estimated total run time in seconds =    3119.06694615604     
 Estimated total run time in hh:mm:ss =    0 h 51 m 59 s
 We have done    79.19622     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        34000
 Time:    80.69263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5469598E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.1340907E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.8845415E-13
 Max of strain, epsilondev_crust_mantle  =  1.1118392E-11
 Elapsed time in seconds =    2506.78134296400     
 Elapsed time in hh:mm:ss =    0 h 41 m 46 s
 Mean elapsed time per time step in seconds =   7.372886302835294E-002
 Time steps done =        34000  out of        42300
 Time steps remaining =         8300
 Estimated remaining time in seconds =    611.949563135329     
 Estimated remaining time in hh:mm:ss =    0 h 10 m 11 s
 Estimated total run time in seconds =    3118.73090609933     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    80.37825     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        34500
 Time:    81.88013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4437321E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.8689681E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.5099909E-13
 Max of strain, epsilondev_crust_mantle  =  4.0280557E-12
 Elapsed time in seconds =    2543.58628837100     
 Elapsed time in hh:mm:ss =    0 h 42 m 23 s
 Mean elapsed time per time step in seconds =   7.372713879336232E-002
 Time steps done =        34500  out of        42300
 Time steps remaining =         7800
 Estimated remaining time in seconds =    575.071682588226     
 Estimated remaining time in hh:mm:ss =    0 h 09 m 35 s
 Estimated total run time in seconds =    3118.65797095923     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    81.56029     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        35000
 Time:    83.06763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.0821744E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.2577643E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.8229308E-13
 Max of strain, epsilondev_crust_mantle  =  3.4876583E-12
 Elapsed time in seconds =    2580.47214055500     
 Elapsed time in hh:mm:ss =    0 h 43 m 00 s
 Mean elapsed time per time step in seconds =   7.372777544442857E-002
 Time steps done =        35000  out of        42300
 Time steps remaining =         7300
 Estimated remaining time in seconds =    538.212760744329     
 Estimated remaining time in hh:mm:ss =    0 h 08 m 58 s
 Estimated total run time in seconds =    3118.68490129933     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    82.74232     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        35500
 Time:    84.25513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.9065316E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.9324403E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.3899117E-13
 Max of strain, epsilondev_crust_mantle  =  4.1318589E-12
 Elapsed time in seconds =    2617.42579434900     
 Elapsed time in hh:mm:ss =    0 h 43 m 37 s
 Mean elapsed time per time step in seconds =   7.373030406616903E-002
 Time steps done =        35500  out of        42300
 Time steps remaining =         6800
 Estimated remaining time in seconds =    501.366067649949     
 Estimated remaining time in hh:mm:ss =    0 h 08 m 21 s
 Estimated total run time in seconds =    3118.79186199895     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    83.92435     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        36000
 Time:    85.44263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4220060E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.0221879E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.3366638E-13
 Max of strain, epsilondev_crust_mantle  =  1.8576200E-12
 Elapsed time in seconds =    2654.09097928800     
 Elapsed time in hh:mm:ss =    0 h 44 m 14 s
 Mean elapsed time per time step in seconds =   7.372474942466667E-002
 Time steps done =        36000  out of        42300
 Time steps remaining =         6300
 Estimated remaining time in seconds =    464.465921375400     
 Estimated remaining time in hh:mm:ss =    0 h 07 m 44 s
 Estimated total run time in seconds =    3118.55690066340     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    85.10638     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        36500
 Time:    86.63013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3357417E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.7599829E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.8845730E-13
 Max of strain, epsilondev_crust_mantle  =  1.8808260E-12
 Elapsed time in seconds =    2690.74065828900     
 Elapsed time in hh:mm:ss =    0 h 44 m 50 s
 Mean elapsed time per time step in seconds =   7.371892214490411E-002
 Time steps done =        36500  out of        42300
 Time steps remaining =         5800
 Estimated remaining time in seconds =    427.569748440444     
 Estimated remaining time in hh:mm:ss =    0 h 07 m 07 s
 Estimated total run time in seconds =    3118.31040672944     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    86.28841     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        37000
 Time:    87.81763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.2607485E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.2051750E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.5293244E-13
 Max of strain, epsilondev_crust_mantle  =  3.2300673E-12
 Elapsed time in seconds =    2727.37084641000     
 Elapsed time in hh:mm:ss =    0 h 45 m 27 s
 Mean elapsed time per time step in seconds =   7.371272557864865E-002
 Time steps done =        37000  out of        42300
 Time steps remaining =         5300
 Estimated remaining time in seconds =    390.677445566838     
 Estimated remaining time in hh:mm:ss =    0 h 06 m 30 s
 Estimated total run time in seconds =    3118.04829197684     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    87.47045     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        37500
 Time:    89.00513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5976539E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.8472820E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.4506164E-13
 Max of strain, epsilondev_crust_mantle  =  4.2055066E-12
 Elapsed time in seconds =    2764.24045895900     
 Elapsed time in hh:mm:ss =    0 h 46 m 04 s
 Mean elapsed time per time step in seconds =   7.371307890557334E-002
 Time steps done =        37500  out of        42300
 Time steps remaining =         4800
 Estimated remaining time in seconds =    353.822778746752     
 Estimated remaining time in hh:mm:ss =    0 h 05 m 53 s
 Estimated total run time in seconds =    3118.06323770575     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    88.65248     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        38000
 Time:    90.19263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3143042E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.1005356E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.4318148E-13
 Max of strain, epsilondev_crust_mantle  =  2.0455590E-12
 Elapsed time in seconds =    2801.22090694900     
 Elapsed time in hh:mm:ss =    0 h 46 m 41 s
 Mean elapsed time per time step in seconds =   7.371633965655264E-002
 Time steps done =        38000  out of        42300
 Time steps remaining =         4300
 Estimated remaining time in seconds =    316.980260523176     
 Estimated remaining time in hh:mm:ss =    0 h 05 m 16 s
 Estimated total run time in seconds =    3118.20116747218     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    89.83452     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        38500
 Time:    91.38013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.9784193E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.7793285E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.0268946E-13
 Max of strain, epsilondev_crust_mantle  =  1.0152778E-11
 Elapsed time in seconds =    2837.93621456700     
 Elapsed time in hh:mm:ss =    0 h 47 m 17 s
 Mean elapsed time per time step in seconds =   7.371262894979222E-002
 Time steps done =        38500  out of        42300
 Time steps remaining =         3800
 Estimated remaining time in seconds =    280.107990009210     
 Estimated remaining time in hh:mm:ss =    0 h 04 m 40 s
 Estimated total run time in seconds =    3118.04420457621     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    91.01655     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        39000
 Time:    92.56763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.6551830E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.1798290E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.6031551E-13
 Max of strain, epsilondev_crust_mantle  =  1.0051010E-11
 Elapsed time in seconds =    2874.68756723700     
 Elapsed time in hh:mm:ss =    0 h 47 m 54 s
 Mean elapsed time per time step in seconds =   7.370993762146154E-002
 Time steps done =        39000  out of        42300
 Time steps remaining =         3300
 Estimated remaining time in seconds =    243.242794150823     
 Estimated remaining time in hh:mm:ss =    0 h 04 m 03 s
 Estimated total run time in seconds =    3117.93036138782     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    92.19858     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        39500
 Time:    93.75513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.0017382E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.3096522E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.1978998E-13
 Max of strain, epsilondev_crust_mantle  =  2.0616098E-12
 Elapsed time in seconds =    2911.61620044800     
 Elapsed time in hh:mm:ss =    0 h 48 m 31 s
 Mean elapsed time per time step in seconds =   7.371180254298734E-002
 Time steps done =        39500  out of        42300
 Time steps remaining =         2800
 Estimated remaining time in seconds =    206.393047120365     
 Estimated remaining time in hh:mm:ss =    0 h 03 m 26 s
 Estimated total run time in seconds =    3118.00924756836     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    93.38062     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        40000
 Time:    94.94263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.8499624E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.3590779E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.0633975E-13
 Max of strain, epsilondev_crust_mantle  =  1.5590671E-11
 Elapsed time in seconds =    2948.57628422200     
 Elapsed time in hh:mm:ss =    0 h 49 m 08 s
 Mean elapsed time per time step in seconds =   7.371440710555001E-002
 Time steps done =        40000  out of        42300
 Time steps remaining =         2300
 Estimated remaining time in seconds =    169.543136342765     
 Estimated remaining time in hh:mm:ss =    0 h 02 m 49 s
 Estimated total run time in seconds =    3118.11942056477     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    94.56264     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        40500
 Time:    96.13013      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2537329E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.6211504E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.7408943E-13
 Max of strain, epsilondev_crust_mantle  =  1.5951988E-11
 Elapsed time in seconds =    2985.50194366300     
 Elapsed time in hh:mm:ss =    0 h 49 m 45 s
 Mean elapsed time per time step in seconds =   7.371609737439506E-002
 Time steps done =        40500  out of        42300
 Time steps remaining =         1800
 Estimated remaining time in seconds =    132.688975273911     
 Estimated remaining time in hh:mm:ss =    0 h 02 m 12 s
 Estimated total run time in seconds =    3118.19091893691     
 Estimated total run time in hh:mm:ss =    0 h 51 m 58 s
 We have done    95.74468     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        41000
 Time:    97.31763      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.8898816E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5125568E-17
 Max of strain, eps_trace_over_3_crust_mantle =  3.2271950E-13
 Max of strain, epsilondev_crust_mantle  =  1.5781241E-12
 Elapsed time in seconds =    3022.14197510200     
 Elapsed time in hh:mm:ss =    0 h 50 m 22 s
 Mean elapsed time per time step in seconds =   7.371077988053658E-002
 Time steps done =        41000  out of        42300
 Time steps remaining =         1300
 Estimated remaining time in seconds =    95.8240138446975     
 Estimated remaining time in hh:mm:ss =    0 h 01 m 35 s
 Estimated total run time in seconds =    3117.96598894670     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    96.92671     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        41500
 Time:    98.50513      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.1928814E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.0272056E-17
 Max of strain, eps_trace_over_3_crust_mantle =  2.2866905E-13
 Max of strain, epsilondev_crust_mantle  =  1.8724284E-11
 Elapsed time in seconds =    3058.65596595900     
 Elapsed time in hh:mm:ss =    0 h 50 m 58 s
 Mean elapsed time per time step in seconds =   7.370255339660242E-002
 Time steps done =        41500  out of        42300
 Time steps remaining =          800
 Estimated remaining time in seconds =    58.9620427172819     
 Estimated remaining time in hh:mm:ss =    0 h 00 m 58 s
 Estimated total run time in seconds =    3117.61800867628     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    98.10875     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:58
 
 Time step #        42000
 Time:    99.69263      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.0820249E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.6415495E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.6219510E-13
 Max of strain, epsilondev_crust_mantle  =  2.0642588E-11
 Elapsed time in seconds =    3095.53087291300     
 Elapsed time in hh:mm:ss =    0 h 51 m 35 s
 Mean elapsed time per time step in seconds =   7.370311602173810E-002
 Time steps done =        42000  out of        42300
 Time steps remaining =          300
 Estimated remaining time in seconds =    22.1109348065214     
 Estimated remaining time in hh:mm:ss =    0 h 00 m 22 s
 Estimated total run time in seconds =    3117.64180771952     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    99.29078     % of that
 The run will finish approximately on (in local time): Mon Oct 07, 2024 18:57
 
 Time step #        42300
 Time:    100.4051      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.7617232E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5110408E-17
 Max of strain, eps_trace_over_3_crust_mantle =  1.2596713E-13
 Max of strain, epsilondev_crust_mantle  =  1.4349567E-11
 Elapsed time in seconds =    3117.78550227900     
 Elapsed time in hh:mm:ss =    0 h 51 m 57 s
 Mean elapsed time per time step in seconds =   7.370651305624114E-002
 Time steps done =        42300  out of        42300
 Time steps remaining =            0
 Estimated remaining time in seconds =   0.000000000000000E+000
 Estimated remaining time in hh:mm:ss =    0 h 00 m 00 s
 Estimated total run time in seconds =    3117.78550227900     
 Estimated total run time in hh:mm:ss =    0 h 51 m 57 s
 We have done    100.0000     % of that
 
 Time-Loop Complete. Timing info:
 Total elapsed time in seconds =    3117.85535421800     
 Total elapsed time in hh:mm:ss =    0 h 51 m 57 s
 
 End of the simulation
 

[dosoe]

Here is output_mesher.txt for the latest version of specfem devel:

 
 ****************************
 *** Specfem3D MPI Mesher ***
 ****************************
 
 Version: v8.1.0-193-ge4e2d687
 
 
 Planet: Earth
 
 
 There are          294  MPI processes
 Processes are numbered from 0 to          293
 
 There are          112  elements along xi in each chunk
 There are          112  elements along eta in each chunk
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks in the global mesh
 There is a total of          294  slices in the global mesh
 
 NGLLX =            5
 NGLLY =            5
 NGLLZ =            5
 
 Shape functions defined by NGNOD =           27  control nodes
 Surface shape functions defined by NGNOD2D =            9  control nodes
 
 using old version backward compatibility (versions 7.0 to 8.0)
 
 model: semucb_a3d
   incorporating the oceans using equivalent load
   incorporating ellipticity
   incorporating surface topography
   incorporating self-gravitation (Cowling approximation)
   incorporating rotation
   incorporating attenuation using            3  standard linear solids
 
   incorporating 3-D lateral variations in the mantle
   no heterogeneities in the mantle
   incorporating crustal variations
   using one layer only in crust
   incorporating transverse isotropy
   no inner-core anisotropy
   no general mantle anisotropy
 
 
 Reference radius of the globe used is    6371.00000000000       km
 
 Central cube is at a radius of    950.000000000000       km
 creating global slice addressing
 
 Spatial distribution of the slices
                       48   41   34   27   20   13    6
                       47   40   33   26   19   12    5
                       46   39   32   25   18   11    4
                       45   38   31   24   17   10    3
                       44   37   30   23   16    9    2
                       43   36   29   22   15    8    1
                       42   35   28   21   14    7    0
  
   146  139  132  125  118  111  104      97   90   83   76   69   62   55     244  237  230  223  216  209  202
   145  138  131  124  117  110  103      96   89   82   75   68   61   54     243  236  229  222  215  208  201
   144  137  130  123  116  109  102      95   88   81   74   67   60   53     242  235  228  221  214  207  200
   143  136  129  122  115  108  101      94   87   80   73   66   59   52     241  234  227  220  213  206  199
   142  135  128  121  114  107  100      93   86   79   72   65   58   51     240  233  226  219  212  205  198
   141  134  127  120  113  106   99      92   85   78   71   64   57   50     239  232  225  218  211  204  197
   140  133  126  119  112  105   98      91   84   77   70   63   56   49     238  231  224  217  210  203  196
  
                      293  286  279  272  265  258  251
                      292  285  278  271  264  257  250
                      291  284  277  270  263  256  249
                      290  283  276  269  262  255  248
                      289  282  275  268  261  254  247
                      288  281  274  267  260  253  246
                      287  280  273  266  259  252  245
  
                      195  188  181  174  167  160  153
                      194  187  180  173  166  159  152
                      193  186  179  172  165  158  151
                      192  185  178  171  164  157  150
                      191  184  177  170  163  156  149
                      190  183  176  169  162  155  148
                      189  182  175  168  161  154  147
  
 
 incorporating topography
   topo file            : DATA/SEMUCB_A3d/ETOPO5_1x1_filtre.dat
   resolution in minutes:    60.00000    
 
   topography/bathymetry: min/max =        -7170        5568
 
   Elapsed time for reading in seconds =   1.250067414366640E-002
 
 
   VTK topo output: topo resolution in minutes =    60.00000    
                    samples per degree         =    1.000000    
                    resolution distance        =    111.1949     (km)
                    full globe NLAT =          180
                               NLON =          360
                               total number of points NLAT x NLON =        64800
 
   elevations written to file: ./DATABASES_MPI/mesh_topo_bathy.vtk
   min/max =   -6.105000     /   5.358000     (km)
 
 broadcast model: SEMUCB Berkeley
   number of parameters: NBPARAM =            2
 
 incorporating crustal model: Berkeley
 
 
   VTK moho output: resolution =            1 deg
                    NLAT =          180
                    NLON =          360
 
   moho depths written to file: ./DATABASES_MPI/mesh_moho_depth.vtk
   min/max =    30.00000     /   60.00001     (km)
 
   sediment depths written to file: ./DATABASES_MPI/mesh_sediment_depth.vtk
   min/max =   0.0000000E+00 /  0.0000000E+00 (km)
 
 attenuation model:
   1D reference model
   model: Berkeley attenuation
 
 additional mesh optimizations
 
 moho:
   default  2-layer crust
   incorporating element stretching for 3-D moho surface
 
 internal topography 410/660:
   no element stretching for 3-D internal surfaces
 
 
 Radial Meshing parameters:
   NCHUNKS                =            6
 
   CENTER LAT/LON:            0.0000000E+00 /  0.0000000E+00
   GAMMA_ROTATION_AZIMUTH:    0.0000000E+00
 
   CHUNK WIDTH XI/ETA:         90.00000     /   90.00000    
   NEX XI/ETA:                       112 /         112
 
   NER_CRUST:                          2
   NER_80_MOHO:                        1
   NER_220_80:                         2
   NER_400_220:                        2
   NER_600_400:                        2
   NER_670_600:                        1
   NER_771_670:                        1
   NER_TOPDDOUBLEPRIME_771:           15
   NER_CMB_TOPDDOUBLEPRIME:            1
   NER_OUTER_CORE:                    16
   NER_TOP_CENTRAL_CUBE_ICB:           2
   SUPPRESS_CRUSTAL_MESH:    F
 
   R_CENTRAL_CUBE =    950.0000      km
 
 Mesh resolution:
   DT =   0.140000000000000     
   Minimum period =    39.64286      (s)
 
   MIN_ATTENUATION_PERIOD =    39.00000    
   MAX_ATTENUATION_PERIOD =    2229.000    
 
 
 
 *******************************************
 creating mesh in region            1
 this region is the crust and mantle
 *******************************************
 
 
 first pass
 
   ...allocating arrays
 
   ...setting up layers
 
   ...creating mesh elements
   creating layer            1 out of           10
     number of regular elements  =            0
     number of doubling elements =          448
   setting tiso flags in mantle model
     using fully transverse isotopic mantle
     using formatting from old versions (7.0 to 8.0)
     10.0%    current clock (NOT elapsed) time is: 18h 44min 39sec
   creating layer            2 out of           10
     number of regular elements  =          128
     20.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            3 out of           10
     number of regular elements  =           16
     30.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            4 out of           10
     number of regular elements  =           96
     number of doubling elements =          128
     40.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            5 out of           10
     number of regular elements  =          448
     50.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            6 out of           10
     number of regular elements  =           64
     60.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            7 out of           10
     number of regular elements  =           64
     70.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            8 out of           10
     number of regular elements  =          128
     80.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer            9 out of           10
     number of regular elements  =          128
     90.0%    current clock (NOT elapsed) time is: 18h 44min 41sec
   creating layer           10 out of           10
     number of regular elements  =          512
    100.0%    current clock (NOT elapsed) time is: 18h 44min 48sec
   layers done
 
   number of elements (per slice)        =         2160
   total number of elements (all slices) =       635040
 
 
   ...creating global addressing
     total number of points            :       270000
     array memory required per process :    6.179810     MB
     getting global points             : npointot =       270000  nspec = 
        2160
     creating indirect addressing
     ibool ok
 
   ...creating MPI buffers
 
 second pass
 
   ...allocating arrays
 
   ...setting up layers
 
   ...creating mesh elements
   creating layer            1 out of           10
     number of regular elements  =            0
     number of doubling elements =          448
     10.0%    current clock (NOT elapsed) time is: 18h 45min 13sec
   creating layer            2 out of           10
     number of regular elements  =          128
     20.0%    current clock (NOT elapsed) time is: 18h 45min 19sec
   creating layer            3 out of           10
     number of regular elements  =           16
     30.0%    current clock (NOT elapsed) time is: 18h 45min 19sec
   creating layer            4 out of           10
     number of regular elements  =           96
     number of doubling elements =          128
     40.0%    current clock (NOT elapsed) time is: 18h 45min 25sec
   creating layer            5 out of           10
     number of regular elements  =          448
     50.0%    current clock (NOT elapsed) time is: 18h 45min 38sec
   creating layer            6 out of           10
     number of regular elements  =           64
     60.0%    current clock (NOT elapsed) time is: 18h 45min 40sec
   creating layer            7 out of           10
     number of regular elements  =           64
     70.0%    current clock (NOT elapsed) time is: 18h 45min 42sec
   creating layer            8 out of           10
     number of regular elements  =          128
     80.0%    current clock (NOT elapsed) time is: 18h 45min 46sec
   creating layer            9 out of           10
     number of regular elements  =          128
     90.0%    current clock (NOT elapsed) time is: 18h 45min 49sec
   creating layer           10 out of           10
     number of regular elements  =          512
    100.0%    current clock (NOT elapsed) time is: 18h 46min 29sec
   layers done
 
   number of elements (per slice)        =         2160
   total number of elements (all slices) =       635040
 
 
   ...fills global mesh points
 
   ...checking mesh resolution and time step
 
 ----------------------------------
   Verification of mesh parameters:
 ----------------------------------
   Region is crust/mantle
 
   Min Vs =    3.005147      (km/s)
   Max Vp =    14.14017      (km/s)
 
   Max element edge size =    255.4137      (km)
   Min element edge size =    10.24270      (km)
   Max/min ratio =    24.93616    
 
   Max Jacobian eigenvalue ratio =   0.9996653    
   Min Jacobian eigenvalue ratio =   8.1582561E-02
 
   Minimum period resolved =    27.67641      (s)
   Minimum period resolved (empirical) =    39.64286      (s)
   Maximum suggested time step =   0.1200000      (s)
 
   for DT :   0.1400000      (s)
   Max stability for wave velocities =   0.6374510    
 ----------------------------------
 
   saving vtk mesh files for resolution res_minimum_period...
 
   ...precomputing Jacobian
 
   ...creating chunk buffers
 
 ----- creating chunk buffers -----
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 There is a total of           84  messages to assemble faces between chunks
 
 Generating message            1  for faces out of           84
 Generating message            2  for faces out of           84
 Generating message            3  for faces out of           84
 Generating message            4  for faces out of           84
 Generating message            5  for faces out of           84
 Generating message            6  for faces out of           84
 Generating message            7  for faces out of           84
 Generating message            8  for faces out of           84
 Generating message            9  for faces out of           84
 Generating message           10  for faces out of           84
 Generating message           11  for faces out of           84
 Generating message           12  for faces out of           84
 Generating message           13  for faces out of           84
 Generating message           14  for faces out of           84
 Generating message           15  for faces out of           84
 Generating message           16  for faces out of           84
 Generating message           17  for faces out of           84
 Generating message           18  for faces out of           84
 Generating message           19  for faces out of           84
 Generating message           20  for faces out of           84
 Generating message           21  for faces out of           84
 Generating message           22  for faces out of           84
 Generating message           23  for faces out of           84
 Generating message           24  for faces out of           84
 Generating message           25  for faces out of           84
 Generating message           26  for faces out of           84
 Generating message           27  for faces out of           84
 Generating message           28  for faces out of           84
 Generating message           29  for faces out of           84
 Generating message           30  for faces out of           84
 Generating message           31  for faces out of           84
 Generating message           32  for faces out of           84
 Generating message           33  for faces out of           84
 Generating message           34  for faces out of           84
 Generating message           35  for faces out of           84
 Generating message           36  for faces out of           84
 Generating message           37  for faces out of           84
 Generating message           38  for faces out of           84
 Generating message           39  for faces out of           84
 Generating message           40  for faces out of           84
 Generating message           41  for faces out of           84
 Generating message           42  for faces out of           84
 Generating message           43  for faces out of           84
 Generating message           44  for faces out of           84
 Generating message           45  for faces out of           84
 Generating message           46  for faces out of           84
 Generating message           47  for faces out of           84
 Generating message           48  for faces out of           84
 Generating message           49  for faces out of           84
 Generating message           50  for faces out of           84
 Generating message           51  for faces out of           84
 Generating message           52  for faces out of           84
 Generating message           53  for faces out of           84
 Generating message           54  for faces out of           84
 Generating message           55  for faces out of           84
 Generating message           56  for faces out of           84
 Generating message           57  for faces out of           84
 Generating message           58  for faces out of           84
 Generating message           59  for faces out of           84
 Generating message           60  for faces out of           84
 Generating message           61  for faces out of           84
 Generating message           62  for faces out of           84
 Generating message           63  for faces out of           84
 Generating message           64  for faces out of           84
 Generating message           65  for faces out of           84
 Generating message           66  for faces out of           84
 Generating message           67  for faces out of           84
 Generating message           68  for faces out of           84
 Generating message           69  for faces out of           84
 Generating message           70  for faces out of           84
 Generating message           71  for faces out of           84
 Generating message           72  for faces out of           84
 Generating message           73  for faces out of           84
 Generating message           74  for faces out of           84
 Generating message           75  for faces out of           84
 Generating message           76  for faces out of           84
 Generating message           77  for faces out of           84
 Generating message           78  for faces out of           84
 Generating message           79  for faces out of           84
 Generating message           80  for faces out of           84
 Generating message           81  for faces out of           84
 Generating message           82  for faces out of           84
 Generating message           83  for faces out of           84
 Generating message           84  for faces out of           84
 
 all the messages for chunk faces have the right size
 
 Generating message            1  for corners out of            8
 Generating message            2  for corners out of            8
 Generating message            3  for corners out of            8
 Generating message            4  for corners out of            8
 Generating message            5  for corners out of            8
 Generating message            6  for corners out of            8
 Generating message            7  for corners out of            8
 Generating message            8  for corners out of            8
 
   ...preparing MPI interfaces
 
 crust/mantle region:
   #max of points in MPI buffers along xi npoin2D_xi =         3669
   #max of array elements transferred npoin2D_xi*NDIM =        11007
 
   #max of points in MPI buffers along eta npoin2D_eta =         3669
   #max of array elements transferred npoin2D_eta*NDIM =        11007
 
 crust mantle MPI:
   maximum interfaces:           8
   MPI addressing maximum interfaces:           8
   MPI addressing : all interfaces okay
 
   total MPI interface points :      4440312
   unique MPI interface points:      4186560
   maximum valence            :            3
   total unique MPI interface points:     4186560
 
 
   ...element inner/outer separation
 
   for overlapping of communications with calculations:
   percentage of edge elements in crust/mantle    38.33333     %
   percentage of volume elements in crust/mantle    61.66667     %
 
 
   ...element mesh permutation
 
   ...creating mass matrix
      updates mass matrix with ocean load
        using minimum ocean thickness:    100.000000000000      (m)
 
   ...saving binary files
 
   ...saving mesh files
 
 calculated region volume:    3.501438    
                 top area:    12.55745    
              bottom area:    3.749334    
 
 *******************************************
 creating mesh in region            2
 this region is the outer core
 *******************************************
 
 
 first pass
 
   ...allocating arrays
 
   ...setting up layers
 
   ...creating mesh elements
   creating layer            1 out of            2
     number of regular elements  =           28
     number of doubling elements =           32
     50.0%    current clock (NOT elapsed) time is: 18h 46min 43sec
   creating layer            2 out of            2
     number of regular elements  =          112
    100.0%    current clock (NOT elapsed) time is: 18h 46min 43sec
   layers done
 
   number of elements (per slice)        =          172
   total number of elements (all slices) =        50568
 
 
   ...creating global addressing
     total number of points            :        21500
     array memory required per process :   0.4920959     MB
     getting global points             : npointot =        21500  nspec = 
         172
     creating indirect addressing
     ibool ok
 
   ...creating MPI buffers
 
 second pass
 
   ...allocating arrays
 
   ...setting up layers
 
   ...creating mesh elements
   creating layer            1 out of            2
     number of regular elements  =           28
     number of doubling elements =           32
     50.0%    current clock (NOT elapsed) time is: 18h 46min 43sec
   creating layer            2 out of            2
     number of regular elements  =          112
    100.0%    current clock (NOT elapsed) time is: 18h 46min 43sec
   layers done
 
   number of elements (per slice)        =          172
   total number of elements (all slices) =        50568
 
 
   ...fills global mesh points
 
   ...checking mesh resolution and time step
 
 ----------------------------------
   Verification of mesh parameters:
 ----------------------------------
   Region is outer core
 
   Min Vp =    8.064826      (km/s)
   Max Vp =    10.35568      (km/s)
 
   Max element edge size =    263.8323      (km)
   Min element edge size =    70.45566      (km)
   Max/min ratio =    3.744657    
 
   Max Jacobian eigenvalue ratio =   0.9998946    
   Min Jacobian eigenvalue ratio =   0.1590365    
 
   Minimum period resolved =    21.89825      (s)
   Minimum period resolved (empirical) =    39.64286      (s)
   Maximum suggested time step =   0.6900000      (s)
 
   for DT :   0.1400000      (s)
   Max stability for wave velocities =   0.1111651    
 ----------------------------------
 
   saving vtk mesh files for resolution res_minimum_period...
 
   ...precomputing Jacobian
 
   ...creating chunk buffers
 
 ----- creating chunk buffers -----
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 There is a total of           84  messages to assemble faces between chunks
 
 Generating message            1  for faces out of           84
 Generating message            2  for faces out of           84
 Generating message            3  for faces out of           84
 Generating message            4  for faces out of           84
 Generating message            5  for faces out of           84
 Generating message            6  for faces out of           84
 Generating message            7  for faces out of           84
 Generating message            8  for faces out of           84
 Generating message            9  for faces out of           84
 Generating message           10  for faces out of           84
 Generating message           11  for faces out of           84
 Generating message           12  for faces out of           84
 Generating message           13  for faces out of           84
 Generating message           14  for faces out of           84
 Generating message           15  for faces out of           84
 Generating message           16  for faces out of           84
 Generating message           17  for faces out of           84
 Generating message           18  for faces out of           84
 Generating message           19  for faces out of           84
 Generating message           20  for faces out of           84
 Generating message           21  for faces out of           84
 Generating message           22  for faces out of           84
 Generating message           23  for faces out of           84
 Generating message           24  for faces out of           84
 Generating message           25  for faces out of           84
 Generating message           26  for faces out of           84
 Generating message           27  for faces out of           84
 Generating message           28  for faces out of           84
 Generating message           29  for faces out of           84
 Generating message           30  for faces out of           84
 Generating message           31  for faces out of           84
 Generating message           32  for faces out of           84
 Generating message           33  for faces out of           84
 Generating message           34  for faces out of           84
 Generating message           35  for faces out of           84
 Generating message           36  for faces out of           84
 Generating message           37  for faces out of           84
 Generating message           38  for faces out of           84
 Generating message           39  for faces out of           84
 Generating message           40  for faces out of           84
 Generating message           41  for faces out of           84
 Generating message           42  for faces out of           84
 Generating message           43  for faces out of           84
 Generating message           44  for faces out of           84
 Generating message           45  for faces out of           84
 Generating message           46  for faces out of           84
 Generating message           47  for faces out of           84
 Generating message           48  for faces out of           84
 Generating message           49  for faces out of           84
 Generating message           50  for faces out of           84
 Generating message           51  for faces out of           84
 Generating message           52  for faces out of           84
 Generating message           53  for faces out of           84
 Generating message           54  for faces out of           84
 Generating message           55  for faces out of           84
 Generating message           56  for faces out of           84
 Generating message           57  for faces out of           84
 Generating message           58  for faces out of           84
 Generating message           59  for faces out of           84
 Generating message           60  for faces out of           84
 Generating message           61  for faces out of           84
 Generating message           62  for faces out of           84
 Generating message           63  for faces out of           84
 Generating message           64  for faces out of           84
 Generating message           65  for faces out of           84
 Generating message           66  for faces out of           84
 Generating message           67  for faces out of           84
 Generating message           68  for faces out of           84
 Generating message           69  for faces out of           84
 Generating message           70  for faces out of           84
 Generating message           71  for faces out of           84
 Generating message           72  for faces out of           84
 Generating message           73  for faces out of           84
 Generating message           74  for faces out of           84
 Generating message           75  for faces out of           84
 Generating message           76  for faces out of           84
 Generating message           77  for faces out of           84
 Generating message           78  for faces out of           84
 Generating message           79  for faces out of           84
 Generating message           80  for faces out of           84
 Generating message           81  for faces out of           84
 Generating message           82  for faces out of           84
 Generating message           83  for faces out of           84
 Generating message           84  for faces out of           84
 
 all the messages for chunk faces have the right size
 
 Generating message            1  for corners out of            8
 Generating message            2  for corners out of            8
 Generating message            3  for corners out of            8
 Generating message            4  for corners out of            8
 Generating message            5  for corners out of            8
 Generating message            6  for corners out of            8
 Generating message            7  for corners out of            8
 Generating message            8  for corners out of            8
 
   ...preparing MPI interfaces
 
 outer core region:
   #max of points in MPI buffers along xi npoin2D_xi =          877
   #max of array elements transferred npoin2D_xi*NDIM =         2631
 
   #max of points in MPI buffers along eta npoin2D_eta =          877
   #max of array elements transferred npoin2D_eta*NDIM =         2631
 
 outer core MPI:
   maximum interfaces:           8
   MPI addressing maximum interfaces:           8
   MPI addressing : all interfaces okay
 
   total MPI interface points :      1106232
   unique MPI interface points:       954912
   maximum valence            :            3
   total assembled MPI interface points:      954912
 
 
   ...element inner/outer separation
 
   for overlapping of communications with calculations:
   percentage of edge elements in outer core    81.39535     %
   percentage of volume elements in outer core    18.60465     %
 
 
   ...element mesh permutation
 
   ...creating mass matrix
 
   ...saving binary files
 
   ...saving mesh files
 
 calculated region volume:   0.6531376    
                 top area:    3.749334    
              bottom area:   0.4619365    
 
 *******************************************
 creating mesh in region            3
 this region is the inner core
 *******************************************
 
 
 first pass
 
   ...allocating arrays
 
   ...setting up layers
 
   ...creating mesh elements
   creating layer            1 out of            1
     number of regular elements  =            8
    100.0%    current clock (NOT elapsed) time is: 18h 46min 45sec
   layers done
 
   number of elements (per slice)        =            8
   total number of elements (all slices) =         2352
 
   creating central cube
   central cube done
     total number of elements =           64
 
 
   ...creating global addressing
     total number of points            :         8000
     array memory required per process :   0.1831055     MB
     getting global points             : npointot =         8000  nspec = 
          64
     creating indirect addressing
     ibool ok
 
   ...creating MPI buffers
 
 second pass
 
   ...allocating arrays
 
   ...setting up layers
 
   ...creating mesh elements
   creating layer            1 out of            1
     number of regular elements  =            8
    100.0%    current clock (NOT elapsed) time is: 18h 46min 45sec
   layers done
 
   number of elements (per slice)        =            8
   total number of elements (all slices) =         2352
 
   creating central cube
   central cube done
     total number of elements =           64
 
 
   ...fills global mesh points
 
   ...checking mesh resolution and time step
 
 ----------------------------------
   Verification of mesh parameters:
 ----------------------------------
   Region is inner core
 
   Min Vs =    3.504308      (km/s)
   Max Vp =    11.26220      (km/s)
 
   Max element edge size =    265.1417      (km)
   Min element edge size =    78.36486      (km)
   Max/min ratio =    3.383425    
 
   Max Jacobian eigenvalue ratio =   0.9993432    
   Min Jacobian eigenvalue ratio =   0.3343522    
 
   Minimum period resolved =    40.05939      (s)
   Minimum period resolved (empirical) =    39.64286      (s)
   Maximum suggested time step =   0.6650000      (s)
 
   for DT :   0.1400000      (s)
   Max stability for wave velocities =   0.1155572    
 ----------------------------------
 
   saving vtk mesh files for resolution res_minimum_period...
 
   ...precomputing Jacobian
 
   ...creating chunk buffers
 
 ----- creating chunk buffers -----
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 There is a total of           84  messages to assemble faces between chunks
 
 Generating message            1  for faces out of           84
 Generating message            2  for faces out of           84
 Generating message            3  for faces out of           84
 Generating message            4  for faces out of           84
 Generating message            5  for faces out of           84
 Generating message            6  for faces out of           84
 Generating message            7  for faces out of           84
 Generating message            8  for faces out of           84
 Generating message            9  for faces out of           84
 Generating message           10  for faces out of           84
 Generating message           11  for faces out of           84
 Generating message           12  for faces out of           84
 Generating message           13  for faces out of           84
 Generating message           14  for faces out of           84
 Generating message           15  for faces out of           84
 Generating message           16  for faces out of           84
 Generating message           17  for faces out of           84
 Generating message           18  for faces out of           84
 Generating message           19  for faces out of           84
 Generating message           20  for faces out of           84
 Generating message           21  for faces out of           84
 Generating message           22  for faces out of           84
 Generating message           23  for faces out of           84
 Generating message           24  for faces out of           84
 Generating message           25  for faces out of           84
 Generating message           26  for faces out of           84
 Generating message           27  for faces out of           84
 Generating message           28  for faces out of           84
 Generating message           29  for faces out of           84
 Generating message           30  for faces out of           84
 Generating message           31  for faces out of           84
 Generating message           32  for faces out of           84
 Generating message           33  for faces out of           84
 Generating message           34  for faces out of           84
 Generating message           35  for faces out of           84
 Generating message           36  for faces out of           84
 Generating message           37  for faces out of           84
 Generating message           38  for faces out of           84
 Generating message           39  for faces out of           84
 Generating message           40  for faces out of           84
 Generating message           41  for faces out of           84
 Generating message           42  for faces out of           84
 Generating message           43  for faces out of           84
 Generating message           44  for faces out of           84
 Generating message           45  for faces out of           84
 Generating message           46  for faces out of           84
 Generating message           47  for faces out of           84
 Generating message           48  for faces out of           84
 Generating message           49  for faces out of           84
 Generating message           50  for faces out of           84
 Generating message           51  for faces out of           84
 Generating message           52  for faces out of           84
 Generating message           53  for faces out of           84
 Generating message           54  for faces out of           84
 Generating message           55  for faces out of           84
 Generating message           56  for faces out of           84
 Generating message           57  for faces out of           84
 Generating message           58  for faces out of           84
 Generating message           59  for faces out of           84
 Generating message           60  for faces out of           84
 Generating message           61  for faces out of           84
 Generating message           62  for faces out of           84
 Generating message           63  for faces out of           84
 Generating message           64  for faces out of           84
 Generating message           65  for faces out of           84
 Generating message           66  for faces out of           84
 Generating message           67  for faces out of           84
 Generating message           68  for faces out of           84
 Generating message           69  for faces out of           84
 Generating message           70  for faces out of           84
 Generating message           71  for faces out of           84
 Generating message           72  for faces out of           84
 Generating message           73  for faces out of           84
 Generating message           74  for faces out of           84
 Generating message           75  for faces out of           84
 Generating message           76  for faces out of           84
 Generating message           77  for faces out of           84
 Generating message           78  for faces out of           84
 Generating message           79  for faces out of           84
 Generating message           80  for faces out of           84
 Generating message           81  for faces out of           84
 Generating message           82  for faces out of           84
 Generating message           83  for faces out of           84
 Generating message           84  for faces out of           84
 
 all the messages for chunk faces have the right size
 
 Generating message            1  for corners out of            8
 Generating message            2  for corners out of            8
 Generating message            3  for corners out of            8
 Generating message            4  for corners out of            8
 Generating message            5  for corners out of            8
 Generating message            6  for corners out of            8
 Generating message            7  for corners out of            8
 Generating message            8  for corners out of            8
 
   ...preparing MPI interfaces
 
 inner core region:
   #max of points in MPI buffers along xi npoin2D_xi =          585
   #max of array elements transferred npoin2D_xi*NDIM =         1755
 
   #max of points in MPI buffers along eta npoin2D_eta =          585
   #max of array elements transferred npoin2D_eta*NDIM =         1755
 
 
 including central cube
   number of messages in cube :            9
   number of 2D points in cube:          100
   creating central cube done
 
 inner core MPI:
 inner core with central cube MPI:
   maximum interfaces:          27
   MPI addressing maximum interfaces:          27
   MPI addressing : all interfaces okay
 
   total MPI interface points :       247410
   unique MPI interface points:       186886
   maximum valence            :            7
   total assembled MPI interface points:      186886
 
 
   ...element inner/outer separation
 
   for overlapping of communications with calculations:
   percentage of edge elements in inner core    62.50000     %
   percentage of volume elements in inner core    37.50000     %
 
 
   ...element mesh permutation
 
   ...creating mass matrix
 
   ...saving binary files
 
   ...saving mesh files
 
 calculated region volume:   2.9522054E-02
                 top area:   0.4619365    
              bottom area:   0.2116967    
 
 all mesh regions created - done
 
 *******************************************
 
 finalizing simulation:
 
 calculated volume:    4.18409805330338     
 
 computed total Earth mass for this density model and mesh: 
      5.9792481E+24  kg
    (should be not too far from 5.974E+24 kg)
 
 average density for this density model and mesh: 
       5526.140      kg/m3
    (should be not too far from 5514 kg/m3)
 
 position of the center of mass of the globe for this density model and mesh: 
    x =  -7.6976143E-02  km
    y =   9.0276934E-02  km
    z =   0.2183858      km
    distance to center =   0.2485309      km
 
 Repartition of elements in regions:
 ----------------------------------
 
 number of elements in each slice      :         2396
 total number of elements in all slices:       704424
 
  - crust and mantle       :    90.15025      %
  - outer core             :    7.178631      %
  - inner core             :    2.671118      %
 
 for some mesh statistics, see comments in file OUTPUT_FILES/values_from_mesher.
 h
 
 Load balancing = 100 % by definition
 
 
 the time step of the solver will be DT =   0.1400000    
 
 using single precision for the calculations
 
 smallest and largest possible floating-point numbers are:   1.1754944E-38
  3.4028235E+38
 
 
 Elapsed time for mesh generation and buffer creation in seconds = 
   145.7974    
 Elapsed time for mesh generation and buffer creation in hh:mm:ss =    0 h 02 m 25 s
 
 End of mesh generation
 

[dosoe]

Here is output_solver.txt for the latest devel version:

 
 ******************************
 **** Specfem3D MPI Solver ****
 ******************************
 
 Version: v8.1.0-193-ge4e2d687
 
 
 Planet: Earth
 
 
 There are          294  MPI processes
 Processes are numbered from 0 to          293
 
 There are          112  elements along xi in each chunk
 There are          112  elements along eta in each chunk
 
 There are            7  slices along xi in each chunk
 There are            7  slices along eta in each chunk
 There is a total of           49  slices in each chunk
 There are            6  chunks
 There is a total of          294  slices in all the chunks
 
 NDIM =            3
 
 NGLLX =            5
 NGLLY =            5
 NGLLZ =            5
 
 using single precision for the calculations
 
 smallest and largest possible floating-point numbers are:   1.1754944E-38
  3.4028235E+38
 
 using old version backward compatibility (versions 7.0 to 8.0)
 
 model: semucb_a3d
   incorporating the oceans using equivalent load
   incorporating ellipticity
   incorporating surface topography
   incorporating self-gravitation (Cowling approximation)
   incorporating rotation
   incorporating attenuation using            3  standard linear solids
 
   incorporating 3-D lateral variations in the mantle
   no heterogeneities in the mantle
   incorporating crustal variations
   using one layer only in crust
   incorporating transverse isotropy
   no inner-core anisotropy
   no general mantle anisotropy
 
 
 creating global slice addressing
 
 Spatial distribution of the slices
                       48   41   34   27   20   13    6
                       47   40   33   26   19   12    5
                       46   39   32   25   18   11    4
                       45   38   31   24   17   10    3
                       44   37   30   23   16    9    2
                       43   36   29   22   15    8    1
                       42   35   28   21   14    7    0
  
   146  139  132  125  118  111  104      97   90   83   76   69   62   55     244  237  230  223  216  209  202
   145  138  131  124  117  110  103      96   89   82   75   68   61   54     243  236  229  222  215  208  201
   144  137  130  123  116  109  102      95   88   81   74   67   60   53     242  235  228  221  214  207  200
   143  136  129  122  115  108  101      94   87   80   73   66   59   52     241  234  227  220  213  206  199
   142  135  128  121  114  107  100      93   86   79   72   65   58   51     240  233  226  219  212  205  198
   141  134  127  120  113  106   99      92   85   78   71   64   57   50     239  232  225  218  211  204  197
   140  133  126  119  112  105   98      91   84   77   70   63   56   49     238  231  224  217  210  203  196
  
                      293  286  279  272  265  258  251
                      292  285  278  271  264  257  250
                      291  284  277  270  263  256  249
                      290  283  276  269  262  255  248
                      289  282  275  268  261  254  247
                      288  281  274  267  260  253  246
                      287  280  273  266  259  252  245
  
                      195  188  181  174  167  160  153
                      194  187  180  173  166  159  152
                      193  186  179  172  165  158  151
                      192  185  178  171  164  157  150
                      191  184  177  170  163  156  149
                      190  183  176  169  162  155  148
                      189  182  175  168  161  154  147
  
 mesh databases:
   reading in crust/mantle databases...
   reading in outer core databases...
   reading in inner core databases...
   reading in coupling surface databases...
   reading in MPI databases...
   for overlapping of communications with calculations:
 
   percentage of edge elements in crust/mantle    38.33333     %
   percentage of volume elements in crust/mantle    61.66667     %
 
   percentage of edge elements in outer core    81.39535     %
   percentage of volume elements in outer core    18.60465     %
 
   percentage of edge elements in inner core    62.50000     %
   percentage of volume elements in inner core    37.50000     %
 
 
 Elapsed time for reading mesh in seconds =   0.4838509    
 
 topography:
   topography/bathymetry: min/max =        -7170        5568
 
 Elapsed time for reading topo/bathy in seconds =   2.1710210E-02
 
 adjacency:
   total number of elements in this slice =         2160
 
   maximum number of elements per shared node      =           16
   node-to-element array memory required per slice =    9.011536     (MB)
 
   maximum neighbors found per element =           37 
 (should be 37 for globe meshes)
   total number of neighbors           =        47284
 
   Elapsed time for detection of neighbors in seconds =   9.209302603267133E-003
 
 kd-tree:
   total data points:         2160
   theoretical   number of nodes:         4316
                tree memory size:   0.1317139     MB
   actual        number of nodes:         4319
                tree memory size:   0.1318054     MB
   maximum depth   :           16
   creation timing :   6.1798096E-04 (s)
 
 
 sources:           1
 
 ********************
  locating sources
 ********************
 
 
 source #            1
 
   source located in slice          191
                  in element         1979
 
   at xi,eta,gamma coordinates =  -0.8528802      0.6159831     -0.1069937    
   at (x,y,z)                  =  -0.5901931      0.7886404      0.1560247    
 
   using moment tensor source
 
   source time function:
     using Berkeley UCB (quasi) Heaviside source time function
              source T1/T2/T3/T4:    500.0000     /   400.0000     /
   50.00000     /   40.00000    
              source time-shift :    500.0000    
     time shift:   0.000000000000000E+000  seconds
 
   magnitude of the source:
        scalar moment M0 =   1.058504638629420E+025  dyne-cm
     moment magnitude Mw =    5.98312870109856     
 
 
   original (requested) position of the source:
 
         latitude:    9.06000000000000     
        longitude:    126.810000000000     
            depth:    19.0000000000000       km
 
   position of the source that will be used:
 
         latitude:    9.06000000000001     
        longitude:    126.810000000000     
            depth:    18.9999999999991       km
 
   Error in location of the source:   7.2909197E-13  km
 
 maximum error in location of the sources:   7.2909197E-13  km
 
 
 Elapsed time for detection of sources in seconds =   8.107061497867107E-003
 
 End of source detection - done
 
 
 receivers:
 
 Total number of receivers =           25
 
 
 ********************
  locating receivers
 ********************
 
 reading receiver information...
 
 Stations sorted by epicentral distance:
 Station #    15:             US.__IU._DAV    epicentral distance:      2.322989 degrees
 Station #    22:             US.__IU.TATO    epicentral distance:     16.616497 degrees
 Station #    23:             US.__PS._OGS    epicentral distance:     23.075397 degrees
 Station #     7:             US.__GE._PMG    epicentral distance:     27.330933 degrees
 Station #    19:             US.__IU._PMG    epicentral distance:     27.332245 degrees
 Station #     3:             US.___G._INU    epicentral distance:     27.786556 degrees
 Station #    14:             US.__IU.CHTO    epicentral distance:     28.689964 degrees
 Station #    17:             US.__IU.MAJO    epicentral distance:     29.256006 degrees
 Station #    25:             US.__PS._TSK    epicentral distance:     29.615301 degrees
 Station #    12:             US.__II.WRAB    epicentral distance:     29.755510 degrees
 Station #     9:             US.__IC._XAN    epicentral distance:     29.802565 degrees
 Station #    24:             US.__PS.PATS    epicentral distance:     31.274904 degrees
 Station #     8:             US.__IC._BJT    epicentral distance:     32.258080 degrees
 Station #    16:             US.__IU._HNR    epicentral distance:     37.766846 degrees
 Station #    18:             US.__IU.NWAO    epicentral distance:     42.739273 degrees
 Station #     1:             US.___G._CAN    epicentral distance:     48.863762 degrees
 Station #     6:             US.___G._PVC    epicentral distance:     48.883606 degrees
 Station #     4:             US.___G.NOUC    epicentral distance:     49.585251 degrees
 Station #    11:             US.__II._TAU    epicentral distance:     55.004650 degrees
 Station #    10:             US.__II.MSVF    epicentral distance:     57.189213 degrees
 Station #    13:             US.__IU._AFI    epicentral distance:     65.062126 degrees
 Station #    21:             US.__IU.SNZO    epicentral distance:     66.670609 degrees
 Station #     2:             US.___G._DRV    epicentral distance:     76.139534 degrees
 Station #    20:             US.__IU._RAR    epicentral distance:     78.068321 degrees
 Station #     5:             US.___G._PPT    epicentral distance:     86.683128 degrees
 
 Station #           1 : US.___G._CAN
        original latitude:   -35.31871    
       original longitude:    148.9963    
      epicentral distance:    48.86376    
   closest estimate found:   1.6353818E-04  km away
   in slice          133  in element         1902
   at xi,eta,gamma coordinates =   -1.037697      0.1647087       1.000000    
   at (x,y,z)                  =  -0.7009958      0.4212620     -0.5756026    
   at lat/lon                  =   -35.31871       148.9963    
 
 Station #           2 : US.___G._DRV
        original latitude:   -66.66491    
       original longitude:    140.0021    
      epicentral distance:    76.13953    
   closest estimate found:   8.5178412E-02  km away
   in slice          275  in element         1806
   at xi,eta,gamma coordinates =   0.1816851      0.8003404       1.000000    
   at (x,y,z)                  =  -0.3046793      0.2556375     -0.9157972    
   at lat/lon                  =   -66.66491       140.0021    
 
 Station #           3 : US.___G._INU
        original latitude:    35.35000    
       original longitude:    137.0290    
      epicentral distance:    27.78656    
   closest estimate found:   7.4442305E-02  km away
   in slice          146  in element         2124
   at xi,eta,gamma coordinates =   0.3124453     -4.9971599E-02   1.000000    
   at (x,y,z)                  =  -0.5981409      0.5572095      0.5760098    
   at lat/lon                  =    35.35000       137.0290    
 
 Station #           4 : US.___G.NOUC
        original latitude:   -22.09863    
       original longitude:    166.3067    
      epicentral distance:    49.58525    
   closest estimate found:   3.4913674E-02  km away
   in slice          127  in element         2020
   at xi,eta,gamma coordinates =   0.8890883     -0.9187889       1.000000    
   at (x,y,z)                  =  -0.9014136      0.2196300     -0.3741995    
   at lat/lon                  =   -22.09863       166.3067    
 
 Station #           5 : US.___G._PPT
        original latitude:   -17.56900    
       original longitude:   -149.5760    
      epicentral distance:    86.68313    
   closest estimate found:   6.1922990E-02  km away
   in slice          106  in element         2134
   at xi,eta,gamma coordinates =  -0.8744891     -0.7219490       1.000000    
   at (x,y,z)                  =  -0.8227978     -0.4831960     -0.3001060    
   at lat/lon                  =   -17.56900      -149.5760    
 
 Station #           6 : US.___G._PVC
        original latitude:   -17.74000    
       original longitude:    168.3120    
      epicentral distance:    48.88361    
   closest estimate found:   5.2728344E-02  km away
   in slice          128  in element         1694
   at xi,eta,gamma coordinates =   0.2530892      9.0137221E-02   1.000000    
   at (x,y,z)                  =  -0.9336255      0.1931407     -0.3029690    
   at lat/lon                  =   -17.74000       168.3120    
 
 Station #           7 : US.__GE._PMG
        original latitude:   -9.409200    
       original longitude:    147.1539    
      epicentral distance:    27.33093    
   closest estimate found:   0.5181814      km away
   in slice          142  in element         1970
   at xi,eta,gamma coordinates =  -0.5912620      0.7502910       1.000000    
   at (x,y,z)                  =  -0.8297378      0.5356749     -0.1625740    
   at lat/lon                  =   -9.409200       147.1539    
 
 Station #           8 : US.__IC._BJT
        original latitude:    40.01830    
       original longitude:    116.1679    
      epicentral distance:    32.25808    
   closest estimate found:   5.1507741E-02  km away
   in slice          182  in element         1730
   at xi,eta,gamma coordinates =   0.2233904      0.1290006       1.000000    
   at (x,y,z)                  =  -0.3386101      0.6891208      0.6404000    
   at lat/lon                  =    40.01830       116.1679    
 
 Station #           9 : US.__IC._XAN
        original latitude:    34.03130    
       original longitude:    108.9237    
      epicentral distance:    29.80256    
   closest estimate found:   7.6138484E-03  km away
   in slice          175  in element         2064
   at xi,eta,gamma coordinates =  -0.9616724      9.8980993E-02   1.000000    
   at (x,y,z)                  =  -0.2693926      0.7857708      0.5572167    
   at lat/lon                  =    34.03130       108.9237    
 
 Station #          10 : US.__II.MSVF
        original latitude:   -17.74480    
       original longitude:    178.0528    
      epicentral distance:    57.18921    
   closest estimate found:   1.6043697E-03  km away
   in slice          121  in element         1734
   at xi,eta,gamma coordinates =  -0.9127668     -0.1536254       1.000000    
   at (x,y,z)                  =  -0.9530631      3.2402452E-02 -0.3031264    
   at lat/lon                  =   -17.74480       178.0528    
 
 Station #          11 : US.__II._TAU
        original latitude:   -42.90990    
       original longitude:    147.3204    
      epicentral distance:    55.00465    
   closest estimate found:   8.5731402E-02  km away
   in slice          288  in element         1738
   at xi,eta,gamma coordinates =  -0.4543158      0.4053178       1.000000    
   at (x,y,z)                  =  -0.6180793      0.3964891     -0.6780624    
   at lat/lon                  =   -42.90990       147.3204    
 
 Station #          12 : US.__II.WRAB
        original latitude:   -19.93360    
       original longitude:    134.3600    
      epicentral distance:    29.75551    
   closest estimate found:   1.3565036E-02  km away
   in slice          194  in element         1968
   at xi,eta,gamma coordinates =  -0.4424117     -0.5928867       1.000000    
   at (x,y,z)                  =  -0.6582919      0.6731651     -0.3391836    
   at lat/lon                  =   -19.93360       134.3600    
 
 Station #          13 : US.__IU._AFI
        original latitude:   -13.90850    
       original longitude:   -171.7827    
      epicentral distance:    65.06213    
   closest estimate found:   1.5709940E-02  km away
   in slice          114  in element         1868
   at xi,eta,gamma coordinates =   0.2620614      0.5480587       1.000000    
   at (x,y,z)                  =  -0.9614282     -0.1388403     -0.2389484    
   at lat/lon                  =   -13.90850      -171.7827    
 
 Station #          14 : US.__IU.CHTO
        original latitude:    18.81410    
       original longitude:    98.94430    
      epicentral distance:    28.68996    
   closest estimate found:   9.6649434E-03  km away
   in slice          177  in element         1656
   at xi,eta,gamma coordinates =  -6.8441659E-02 -0.7386407       1.000000    
   at (x,y,z)                  =  -0.1473967      0.9365177      0.3208503    
   at lat/lon                  =    18.81410       98.94430    
 
 Station #          15 : US.__IU._DAV
        original latitude:    7.069700    
       original longitude:    125.5791    
      epicentral distance:    2.322989    
   closest estimate found:   0.3465766      km away
   in slice          191  in element         2074
   at xi,eta,gamma coordinates =  -0.4372818     -0.4475431       1.000000    
   at (x,y,z)                  =  -0.5779727      0.8079261      0.1223776    
   at lat/lon                  =    7.069700       125.5791    
 
 Station #          16 : US.__IU._HNR
        original latitude:   -9.438700    
       original longitude:    159.9475    
      epicentral distance:    37.76685    
   closest estimate found:   0.7333557      km away
   in slice          135  in element         2002
   at xi,eta,gamma coordinates =   0.1850228      0.9084594       1.000000    
   at (x,y,z)                  =  -0.9274641      0.3385321     -0.1630413    
   at lat/lon                  =   -9.438700       159.9475    
 
 Station #          17 : US.__IU.MAJO
        original latitude:    36.54567    
       original longitude:    138.2041    
      epicentral distance:    29.25601    
   closest estimate found:   2.2152023E-02  km away
   in slice          146  in element         2152
   at xi,eta,gamma coordinates =   0.1084439       1.025457       1.000000    
   at (x,y,z)                  =  -0.6003379      0.5366876      0.5928778    
   at lat/lon                  =    36.54567       138.2041    
 
 Station #          18 : US.__IU.NWAO
        original latitude:   -32.92770    
       original longitude:    117.2390    
      epicentral distance:    42.73927    
   closest estimate found:   2.7269326E-04  km away
   in slice          188  in element         1796
   at xi,eta,gamma coordinates =   0.3192402      0.7948413       1.000000    
   at (x,y,z)                  =  -0.3849994      0.7478753     -0.5411168    
   at lat/lon                  =   -32.92770       117.2390    
 
 Station #          19 : US.__IU._PMG
        original latitude:   -9.404700    
       original longitude:    147.1597    
      epicentral distance:    27.33224    
   closest estimate found:   0.5012867      km away
   in slice          142  in element         1970
   at xi,eta,gamma coordinates =  -0.5764036      0.7358595       1.000000    
   at (x,y,z)                  =  -0.8298050      0.5355993     -0.1624974    
   at lat/lon                  =   -9.404700       147.1597    
 
 Station #          20 : US.__IU._RAR
        original latitude:   -21.21250    
       original longitude:   -159.7733    
      epicentral distance:    78.06832    
   closest estimate found:   7.8602899E-03  km away
   in slice          106  in element         2062
   at xi,eta,gamma coordinates =  -0.5935936      0.6579904       1.000000    
   at (x,y,z)                  =  -0.8754760     -0.3225757     -0.3597144    
   at lat/lon                  =   -21.21250      -159.7733    
 
 Station #          21 : US.__IU.SNZO
        original latitude:   -41.30870    
       original longitude:    174.7043    
      epicentral distance:    66.67061    
   closest estimate found:   8.9194797E-02  km away
   in slice          119  in element         1806
   at xi,eta,gamma coordinates =   0.3572661      0.1804054       1.000000    
   at (x,y,z)                  =  -0.7498572      6.9505386E-02 -0.6573846    
   at lat/lon                  =   -41.30870       174.7043    
 
 Station #          22 : US.__IU.TATO
        original latitude:    24.97350    
       original longitude:    121.4971    
      epicentral distance:    16.61650    
   closest estimate found:   0.3019162      km away
   in slice          183  in element         1808
   at xi,eta,gamma coordinates =   0.1076655     -0.6072022       1.000000    
   at (x,y,z)                  =  -0.4743967      0.7742330      0.4200860    
   at lat/lon                  =    24.97350       121.4971    
 
 Station #          23 : US.__PS._OGS
        original latitude:    27.05700    
       original longitude:    142.2030    
      epicentral distance:    23.07540    
   closest estimate found:   0.1072875      km away
   in slice          146  in element         1662
   at xi,eta,gamma coordinates =   0.3976936       1.072542       1.000000    
   at (x,y,z)                  =  -0.7046455      0.5465199      0.4524513    
   at lat/lon                  =    27.05700       142.2030    
 
 Station #          24 : US.__PS.PATS
        original latitude:    6.836700    
       original longitude:    158.3152    
      epicentral distance:    31.27490    
   closest estimate found:   5.3171802E-02  km away
   in slice          137  in element         1688
   at xi,eta,gamma coordinates =  -0.8225514      -1.028944       1.000000    
   at (x,y,z)                  =  -0.9231390      0.3670779      0.1183133    
   at lat/lon                  =    6.836700       158.3152    
 
 Station #          25 : US.__PS._TSK
        original latitude:    36.21080    
       original longitude:    140.1097    
      epicentral distance:    29.61530    
   closest estimate found:   0.2026466      km away
   in slice          146  in element         2116
   at xi,eta,gamma coordinates =  -0.8128839      0.2825614       1.000000    
   at (x,y,z)                  =  -0.6204868      0.5186291      0.5881625    
   at lat/lon                  =    36.21080       140.1097    
 
 maximum error in location of all the receivers:   0.7333557      km
 
 Elapsed time for receiver detection in seconds =   3.207967209164053E-003
 
 End of receiver detection - done
 
 
 found a total of           25  receivers in all slices
 this total is okay
 
 source arrays:
   number of sources is            1
   size of source array                 =   1.4305115E-03 MB
                                        =   1.3969839E-06 GB
 
 seismograms:
   seismograms written by all processes
   Total number of simulation steps (NSTEP)                       =        42900
   writing out seismograms at every NTSTEP_BETWEEN_OUTPUT_SEISMOS =        42900
   number of subsampling steps for seismograms                    =            1
   Total number of samples for seismograms                        =        42900
 
   maximum number of local receivers is            4  in slice          146
   size of maximum seismogram array       =    1.963806     MB
                                          =   1.9177794E-03 GB
 
 
 Total number of samples for seismograms =        42900
 
 
 Reference radius of the globe used is    6371.00000000000       km
 
 
 incorporating the oceans using equivalent load
 
 incorporating ellipticity
 
 incorporating surface topography
 
 incorporating self-gravitation (Cowling approximation)
 
 incorporating rotation
 
 incorporating attenuation using            3  standard linear solids
 
 
 
 preparing mass matrices
 preparing constants
 preparing gravity arrays
 preparing attenuation
   The code uses a constant Q quality factor, but approximated
   based on a series of Zener standard linear solids (SLS).
   Approximation is performed in the following frequency band:
 
   number of SLS bodies:            3
   partial attenuation, physical dispersion only:  F
 
   Reference frequency of anelastic model (Hz):    1.000000    
                                    period (s):    1.000000    
   Attenuation frequency band min/max (Hz):  4.4863168E-04 /  2.5641026E-02
               period band    min/max (s) :   39.00000     /   2229.000    
   Logarithmic center frequency (Hz):  3.3916628E-03
                      period     (s):   294.8406    
 
   using shear attenuation Q_mu
 
   ATTENUATION_1D_WITH_3D_STORAGE  :  T
   ATTENUATION_3D                  :  F
 preparing elastic element arrays
   using attenuation: shifting to unrelaxed moduli
   crust/mantle transverse isotropic and isotropic elements
   tiso elements =       635040
   iso elements  =            0
   inner core isotropic elements
   iso elements  =         5096
 preparing wavefields
   allocating wavefields
   initializing wavefields
 preparing number of runs
   number of runs    :            1
   number of this run:            1
   time stepping     : begin/end =            1 /       42900
 preparing oceans arrays
   number of global points on oceans =         4225
   maximum valence of global points on oceans =    4.000000    
 preparing optimized arrays
   without force vectorization
   using Deville products
   fusing arrays: 
     size of fused arrays =    10.28252     MB
                          =   1.0041520E-02 GB
   fused arrays done
   bandwidth test (STREAM TRIAD): 
      memory accesses =    5.068989     MB
      timing  min/max =   6.6991861E-04 s /   7.8622741E-04 s
      timing      avg =   6.9720391E-04 s
      bandwidth       =    7.100053     GB/s
 
 
 Elapsed time for preparing timerun in seconds =   0.3562215    
 
 
 time loop:
 
               scheme:         Newmark
            time step:   0.1400000      s
 number of time steps:        42900
   current time steps:            1  to        42900
 total simulated time:    100.0977      minutes
 start time          :  0.0000000E+00  seconds
 
 All processes are synchronized before time loop
 
 Starting time iteration loop...
 
 Time step #            5
 Time:   9.3333330E-03  minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.2559970E-11
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    0.0000000E+00
 Max of strain, epsilondev_crust_mantle  =  6.4777527E-15
 Elapsed time in seconds =   0.2004076    
 Elapsed time in hh:mm:ss =      0 h 00 m 00 s
 Mean elapsed time per time step in seconds =   4.0081512E-02
 Time steps done =            5  out of        42900
 Time steps remaining =        42895
 Estimated remaining time in seconds =    1719.297    
 Estimated remaining time in hh:mm:ss =      0 h 28 m 39 s
 Estimated total run time in seconds =    1719.497    
 Estimated total run time in hh:mm:ss =      0 h 28 m 39 s
 We have done   1.1655011E-02 % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:18
 ************************************************************
 **** BEWARE: the above time estimates are not very reliable
 **** because fewer than 100 iterations have been performed
 ************************************************************
 
 Time step #          500
 Time:    1.164333      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.0704408E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    0.0000000E+00
 Max of strain, epsilondev_crust_mantle  =  4.4205378E-10
 Elapsed time in seconds =    22.73127    
 Elapsed time in hh:mm:ss =      0 h 00 m 22 s
 Mean elapsed time per time step in seconds =   4.5462541E-02
 Time steps done =          500  out of        42900
 Time steps remaining =        42400
 Estimated remaining time in seconds =    1927.612    
 Estimated remaining time in hh:mm:ss =      0 h 32 m 07 s
 Estimated total run time in seconds =    1950.343    
 Estimated total run time in hh:mm:ss =      0 h 32 m 30 s
 We have done    1.165501     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         1000
 Time:    2.331000      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.1130969E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.6330455E-34
 Max of strain, epsilondev_crust_mantle  =  2.4390885E-09
 Elapsed time in seconds =    45.04593    
 Elapsed time in hh:mm:ss =      0 h 00 m 45 s
 Mean elapsed time per time step in seconds =   4.5045927E-02
 Time steps done =         1000  out of        42900
 Time steps remaining =        41900
 Estimated remaining time in seconds =    1887.424    
 Estimated remaining time in hh:mm:ss =      0 h 31 m 27 s
 Estimated total run time in seconds =    1932.470    
 Estimated total run time in hh:mm:ss =      0 h 32 m 12 s
 We have done    2.331002     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         1500
 Time:    3.497667      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.2951591E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.4989464E-27
 Max of strain, epsilondev_crust_mantle  =  2.8295906E-09
 Elapsed time in seconds =    66.79359    
 Elapsed time in hh:mm:ss =      0 h 01 m 06 s
 Mean elapsed time per time step in seconds =   4.4529058E-02
 Time steps done =         1500  out of        42900
 Time steps remaining =        41400
 Estimated remaining time in seconds =    1843.503    
 Estimated remaining time in hh:mm:ss =      0 h 30 m 43 s
 Estimated total run time in seconds =    1910.297    
 Estimated total run time in hh:mm:ss =      0 h 31 m 50 s
 We have done    3.496504     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         2000
 Time:    4.664333      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.9218858E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.0965528E-20
 Max of strain, epsilondev_crust_mantle  =  4.2290646E-10
 Elapsed time in seconds =    88.52493    
 Elapsed time in hh:mm:ss =      0 h 01 m 28 s
 Mean elapsed time per time step in seconds =   4.4262461E-02
 Time steps done =         2000  out of        42900
 Time steps remaining =        40900
 Estimated remaining time in seconds =    1810.335    
 Estimated remaining time in hh:mm:ss =      0 h 30 m 10 s
 Estimated total run time in seconds =    1898.860    
 Estimated total run time in hh:mm:ss =      0 h 31 m 38 s
 We have done    4.662004     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         2500
 Time:    5.831000      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.4101332E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.8560038E-19
 Max of strain, epsilondev_crust_mantle  =  3.1698708E-09
 Elapsed time in seconds =    110.2458    
 Elapsed time in hh:mm:ss =      0 h 01 m 50 s
 Mean elapsed time per time step in seconds =   4.4098325E-02
 Time steps done =         2500  out of        42900
 Time steps remaining =        40400
 Estimated remaining time in seconds =    1781.572    
 Estimated remaining time in hh:mm:ss =      0 h 29 m 41 s
 Estimated total run time in seconds =    1891.818    
 Estimated total run time in hh:mm:ss =      0 h 31 m 31 s
 We have done    5.827506     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         3000
 Time:    6.997667      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.0355458E-04
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.5394519E-19
 Max of strain, epsilondev_crust_mantle  =  2.1699003E-08
 Elapsed time in seconds =    131.9805    
 Elapsed time in hh:mm:ss =      0 h 02 m 11 s
 Mean elapsed time per time step in seconds =   4.3993510E-02
 Time steps done =         3000  out of        42900
 Time steps remaining =        39900
 Estimated remaining time in seconds =    1755.341    
 Estimated remaining time in hh:mm:ss =      0 h 29 m 15 s
 Estimated total run time in seconds =    1887.322    
 Estimated total run time in hh:mm:ss =      0 h 31 m 27 s
 We have done    6.993007     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         3500
 Time:    8.164333      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.9260508E-04
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.2532538E-18
 Max of strain, epsilondev_crust_mantle  =  8.3652580E-08
 Elapsed time in seconds =    153.7158    
 Elapsed time in hh:mm:ss =      0 h 02 m 33 s
 Mean elapsed time per time step in seconds =   4.3918803E-02
 Time steps done =         3500  out of        42900
 Time steps remaining =        39400
 Estimated remaining time in seconds =    1730.401    
 Estimated remaining time in hh:mm:ss =      0 h 28 m 50 s
 Estimated total run time in seconds =    1884.117    
 Estimated total run time in hh:mm:ss =      0 h 31 m 24 s
 We have done    8.158508     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         4000
 Time:    9.331000      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.0604413E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.6069866E-18
 Max of strain, epsilondev_crust_mantle  =  4.5746118E-10
 Elapsed time in seconds =    175.6244    
 Elapsed time in hh:mm:ss =      0 h 02 m 55 s
 Mean elapsed time per time step in seconds =   4.3906108E-02
 Time steps done =         4000  out of        42900
 Time steps remaining =        38900
 Estimated remaining time in seconds =    1707.948    
 Estimated remaining time in hh:mm:ss =      0 h 28 m 27 s
 Estimated total run time in seconds =    1883.572    
 Estimated total run time in hh:mm:ss =      0 h 31 m 23 s
 We have done    9.324009     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         4500
 Time:    10.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  4.8346948E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9058927E-18
 Max of strain, epsilondev_crust_mantle  =  1.0122877E-08
 Elapsed time in seconds =    197.5844    
 Elapsed time in hh:mm:ss =      0 h 03 m 17 s
 Mean elapsed time per time step in seconds =   4.3907635E-02
 Time steps done =         4500  out of        42900
 Time steps remaining =        38400
 Estimated remaining time in seconds =    1686.053    
 Estimated remaining time in hh:mm:ss =      0 h 28 m 06 s
 Estimated total run time in seconds =    1883.638    
 Estimated total run time in hh:mm:ss =      0 h 31 m 23 s
 We have done    10.48951     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         5000
 Time:    11.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  6.9531229E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.7913763E-18
 Max of strain, epsilondev_crust_mantle  =  1.5332262E-09
 Elapsed time in seconds =    219.2612    
 Elapsed time in hh:mm:ss =      0 h 03 m 39 s
 Mean elapsed time per time step in seconds =   4.3852232E-02
 Time steps done =         5000  out of        42900
 Time steps remaining =        37900
 Estimated remaining time in seconds =    1662.000    
 Estimated remaining time in hh:mm:ss =      0 h 27 m 41 s
 Estimated total run time in seconds =    1881.261    
 Estimated total run time in hh:mm:ss =      0 h 31 m 21 s
 We have done    11.65501     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         5500
 Time:    12.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.1250590E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.6332600E-17
 Max of strain, epsilondev_crust_mantle  =  2.4225280E-09
 Elapsed time in seconds =    241.0083    
 Elapsed time in hh:mm:ss =      0 h 04 m 01 s
 Mean elapsed time per time step in seconds =   4.3819688E-02
 Time steps done =         5500  out of        42900
 Time steps remaining =        37400
 Estimated remaining time in seconds =    1638.856    
 Estimated remaining time in hh:mm:ss =      0 h 27 m 18 s
 Estimated total run time in seconds =    1879.865    
 Estimated total run time in hh:mm:ss =      0 h 31 m 19 s
 We have done    12.82051     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         6000
 Time:    13.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.4079634E-05
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.3546249E-17
 Max of strain, epsilondev_crust_mantle  =  3.0514447E-09
 Elapsed time in seconds =    263.0457    
 Elapsed time in hh:mm:ss =      0 h 04 m 23 s
 Mean elapsed time per time step in seconds =   4.3840945E-02
 Time steps done =         6000  out of        42900
 Time steps remaining =        36900
 Estimated remaining time in seconds =    1617.731    
 Estimated remaining time in hh:mm:ss =      0 h 26 m 57 s
 Estimated total run time in seconds =    1880.776    
 Estimated total run time in hh:mm:ss =      0 h 31 m 20 s
 We have done    13.98601     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         6500
 Time:    15.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  4.4478934E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.0761057E-17
 Max of strain, epsilondev_crust_mantle  =  9.8870889E-10
 Elapsed time in seconds =    284.8142    
 Elapsed time in hh:mm:ss =      0 h 04 m 44 s
 Mean elapsed time per time step in seconds =   4.3817572E-02
 Time steps done =         6500  out of        42900
 Time steps remaining =        36400
 Estimated remaining time in seconds =    1594.960    
 Estimated remaining time in hh:mm:ss =      0 h 26 m 34 s
 Estimated total run time in seconds =    1879.774    
 Estimated total run time in hh:mm:ss =      0 h 31 m 19 s
 We have done    15.15152     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         7000
 Time:    16.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  4.2671982E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.1803355E-16
 Max of strain, epsilondev_crust_mantle  =  9.3151953E-10
 Elapsed time in seconds =    306.5536    
 Elapsed time in hh:mm:ss =      0 h 05 m 06 s
 Mean elapsed time per time step in seconds =   4.3793373E-02
 Time steps done =         7000  out of        42900
 Time steps remaining =        35900
 Estimated remaining time in seconds =    1572.182    
 Estimated remaining time in hh:mm:ss =      0 h 26 m 12 s
 Estimated total run time in seconds =    1878.736    
 Estimated total run time in hh:mm:ss =      0 h 31 m 18 s
 We have done    16.31702     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         7500
 Time:    17.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  7.7794521E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.6129556E-16
 Max of strain, epsilondev_crust_mantle  =  1.6938084E-09
 Elapsed time in seconds =    328.2288    
 Elapsed time in hh:mm:ss =      0 h 05 m 28 s
 Mean elapsed time per time step in seconds =   4.3763835E-02
 Time steps done =         7500  out of        42900
 Time steps remaining =        35400
 Estimated remaining time in seconds =    1549.240    
 Estimated remaining time in hh:mm:ss =      0 h 25 m 49 s
 Estimated total run time in seconds =    1877.469    
 Estimated total run time in hh:mm:ss =      0 h 31 m 17 s
 We have done    17.48252     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         8000
 Time:    18.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  4.3548298E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.3091188E-16
 Max of strain, epsilondev_crust_mantle  =  9.4711838E-10
 Elapsed time in seconds =    349.8421    
 Elapsed time in hh:mm:ss =      0 h 05 m 49 s
 Mean elapsed time per time step in seconds =   4.3730259E-02
 Time steps done =         8000  out of        42900
 Time steps remaining =        34900
 Estimated remaining time in seconds =    1526.186    
 Estimated remaining time in hh:mm:ss =      0 h 25 m 26 s
 Estimated total run time in seconds =    1876.028    
 Estimated total run time in hh:mm:ss =      0 h 31 m 16 s
 We have done    18.64802     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         8500
 Time:    19.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.9194899E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    8.8459456E-17
 Max of strain, epsilondev_crust_mantle  =  4.1989259E-10
 Elapsed time in seconds =    371.4666    
 Elapsed time in hh:mm:ss =      0 h 06 m 11 s
 Mean elapsed time per time step in seconds =   4.3701958E-02
 Time steps done =         8500  out of        42900
 Time steps remaining =        34400
 Estimated remaining time in seconds =    1503.347    
 Estimated remaining time in hh:mm:ss =      0 h 25 m 03 s
 Estimated total run time in seconds =    1874.814    
 Estimated total run time in hh:mm:ss =      0 h 31 m 14 s
 We have done    19.81352     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #         9000
 Time:    20.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.1808902E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.8479115E-17
 Max of strain, epsilondev_crust_mantle  =  1.1234504E-09
 Elapsed time in seconds =    393.1113    
 Elapsed time in hh:mm:ss =      0 h 06 m 33 s
 Mean elapsed time per time step in seconds =   4.3679029E-02
 Time steps done =         9000  out of        42900
 Time steps remaining =        33900
 Estimated remaining time in seconds =    1480.719    
 Estimated remaining time in hh:mm:ss =      0 h 24 m 40 s
 Estimated total run time in seconds =    1873.830    
 Estimated total run time in hh:mm:ss =      0 h 31 m 13 s
 We have done    20.97902     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #         9500
 Time:    22.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6443741E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.0476698E-17
 Max of strain, epsilondev_crust_mantle  =  7.9197393E-10
 Elapsed time in seconds =    414.7601    
 Elapsed time in hh:mm:ss =      0 h 06 m 54 s
 Mean elapsed time per time step in seconds =   4.3658961E-02
 Time steps done =         9500  out of        42900
 Time steps remaining =        33400
 Estimated remaining time in seconds =    1458.209    
 Estimated remaining time in hh:mm:ss =      0 h 24 m 18 s
 Estimated total run time in seconds =    1872.969    
 Estimated total run time in hh:mm:ss =      0 h 31 m 12 s
 We have done    22.14452     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        10000
 Time:    23.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  9.4529929E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.8311940E-17
 Max of strain, epsilondev_crust_mantle  =  1.3993312E-10
 Elapsed time in seconds =    436.4184    
 Elapsed time in hh:mm:ss =      0 h 07 m 16 s
 Mean elapsed time per time step in seconds =   4.3641835E-02
 Time steps done =        10000  out of        42900
 Time steps remaining =        32900
 Estimated remaining time in seconds =    1435.816    
 Estimated remaining time in hh:mm:ss =      0 h 23 m 55 s
 Estimated total run time in seconds =    1872.235    
 Estimated total run time in hh:mm:ss =      0 h 31 m 12 s
 We have done    23.31002     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        10500
 Time:    24.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.5926826E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.0700079E-17
 Max of strain, epsilondev_crust_mantle  =  7.7191614E-10
 Elapsed time in seconds =    458.2486    
 Elapsed time in hh:mm:ss =      0 h 07 m 38 s
 Mean elapsed time per time step in seconds =   4.3642726E-02
 Time steps done =        10500  out of        42900
 Time steps remaining =        32400
 Estimated remaining time in seconds =    1414.024    
 Estimated remaining time in hh:mm:ss =      0 h 23 m 34 s
 Estimated total run time in seconds =    1872.273    
 Estimated total run time in hh:mm:ss =      0 h 31 m 12 s
 We have done    24.47552     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #        11000
 Time:    25.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.9162707E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.4579826E-17
 Max of strain, epsilondev_crust_mantle  =  6.3651817E-10
 Elapsed time in seconds =    480.0082    
 Elapsed time in hh:mm:ss =      0 h 08 m 00 s
 Mean elapsed time per time step in seconds =   4.3637112E-02
 Time steps done =        11000  out of        42900
 Time steps remaining =        31900
 Estimated remaining time in seconds =    1392.024    
 Estimated remaining time in hh:mm:ss =      0 h 23 m 12 s
 Estimated total run time in seconds =    1872.032    
 Estimated total run time in hh:mm:ss =      0 h 31 m 12 s
 We have done    25.64103     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        11500
 Time:    26.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  8.5276338E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.7138778E-17
 Max of strain, epsilondev_crust_mantle  =  1.4558618E-11
 Elapsed time in seconds =    501.6305    
 Elapsed time in hh:mm:ss =      0 h 08 m 21 s
 Mean elapsed time per time step in seconds =   4.3620046E-02
 Time steps done =        11500  out of        42900
 Time steps remaining =        31400
 Estimated remaining time in seconds =    1369.669    
 Estimated remaining time in hh:mm:ss =      0 h 22 m 49 s
 Estimated total run time in seconds =    1871.300    
 Estimated total run time in hh:mm:ss =      0 h 31 m 11 s
 We have done    26.80653     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        12000
 Time:    27.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3366463E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.2050698E-17
 Max of strain, epsilondev_crust_mantle  =  5.0843951E-10
 Elapsed time in seconds =    523.2523    
 Elapsed time in hh:mm:ss =      0 h 08 m 43 s
 Mean elapsed time per time step in seconds =   4.3604352E-02
 Time steps done =        12000  out of        42900
 Time steps remaining =        30900
 Estimated remaining time in seconds =    1347.375    
 Estimated remaining time in hh:mm:ss =      0 h 22 m 27 s
 Estimated total run time in seconds =    1870.627    
 Estimated total run time in hh:mm:ss =      0 h 31 m 10 s
 We have done    27.97203     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        12500
 Time:    29.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3609075E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.7022277E-17
 Max of strain, epsilondev_crust_mantle  =  5.1216675E-10
 Elapsed time in seconds =    544.8760    
 Elapsed time in hh:mm:ss =      0 h 09 m 04 s
 Mean elapsed time per time step in seconds =   4.3590084E-02
 Time steps done =        12500  out of        42900
 Time steps remaining =        30400
 Estimated remaining time in seconds =    1325.139    
 Estimated remaining time in hh:mm:ss =      0 h 22 m 05 s
 Estimated total run time in seconds =    1870.015    
 Estimated total run time in hh:mm:ss =      0 h 31 m 10 s
 We have done    29.13753     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        13000
 Time:    30.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  7.6518813E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.8209552E-17
 Max of strain, epsilondev_crust_mantle  =  9.5313854E-11
 Elapsed time in seconds =    566.5147    
 Elapsed time in hh:mm:ss =      0 h 09 m 26 s
 Mean elapsed time per time step in seconds =   4.3578055E-02
 Time steps done =        13000  out of        42900
 Time steps remaining =        29900
 Estimated remaining time in seconds =    1302.984    
 Estimated remaining time in hh:mm:ss =      0 h 21 m 42 s
 Estimated total run time in seconds =    1869.499    
 Estimated total run time in hh:mm:ss =      0 h 31 m 09 s
 We have done    30.30303     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        13500
 Time:    31.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.4673395E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5667802E-17
 Max of strain, epsilondev_crust_mantle  =  3.1985059E-10
 Elapsed time in seconds =    588.1240    
 Elapsed time in hh:mm:ss =      0 h 09 m 48 s
 Mean elapsed time per time step in seconds =   4.3564737E-02
 Time steps done =        13500  out of        42900
 Time steps remaining =        29400
 Estimated remaining time in seconds =    1280.803    
 Estimated remaining time in hh:mm:ss =      0 h 21 m 20 s
 Estimated total run time in seconds =    1868.927    
 Estimated total run time in hh:mm:ss =      0 h 31 m 08 s
 We have done    31.46853     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        14000
 Time:    32.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.8470726E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.4493704E-17
 Max of strain, epsilondev_crust_mantle  =  4.0058076E-10
 Elapsed time in seconds =    609.7707    
 Elapsed time in hh:mm:ss =      0 h 10 m 09 s
 Mean elapsed time per time step in seconds =   4.3555047E-02
 Time steps done =        14000  out of        42900
 Time steps remaining =        28900
 Estimated remaining time in seconds =    1258.741    
 Estimated remaining time in hh:mm:ss =      0 h 20 m 58 s
 Estimated total run time in seconds =    1868.512    
 Estimated total run time in hh:mm:ss =      0 h 31 m 08 s
 We have done    32.63403     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        14500
 Time:    33.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  8.2639133E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.0695430E-17
 Max of strain, epsilondev_crust_mantle  =  1.3222337E-10
 Elapsed time in seconds =    631.4663    
 Elapsed time in hh:mm:ss =      0 h 10 m 31 s
 Mean elapsed time per time step in seconds =   4.3549404E-02
 Time steps done =        14500  out of        42900
 Time steps remaining =        28400
 Estimated remaining time in seconds =    1236.803    
 Estimated remaining time in hh:mm:ss =      0 h 20 m 36 s
 Estimated total run time in seconds =    1868.269    
 Estimated total run time in hh:mm:ss =      0 h 31 m 08 s
 We have done    33.79953     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        15000
 Time:    34.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  9.2640892E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.0398103E-17
 Max of strain, epsilondev_crust_mantle  =  1.9329226E-10
 Elapsed time in seconds =    653.1304    
 Elapsed time in hh:mm:ss =      0 h 10 m 53 s
 Mean elapsed time per time step in seconds =   4.3542024E-02
 Time steps done =        15000  out of        42900
 Time steps remaining =        27900
 Estimated remaining time in seconds =    1214.823    
 Estimated remaining time in hh:mm:ss =      0 h 20 m 14 s
 Estimated total run time in seconds =    1867.953    
 Estimated total run time in hh:mm:ss =      0 h 31 m 07 s
 We have done    34.96503     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        15500
 Time:    36.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.3674154E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.5667678E-17
 Max of strain, epsilondev_crust_mantle  =  2.9670888E-10
 Elapsed time in seconds =    674.7802    
 Elapsed time in hh:mm:ss =      0 h 11 m 14 s
 Mean elapsed time per time step in seconds =   4.3534208E-02
 Time steps done =        15500  out of        42900
 Time steps remaining =        27400
 Estimated remaining time in seconds =    1192.837    
 Estimated remaining time in hh:mm:ss =      0 h 19 m 52 s
 Estimated total run time in seconds =    1867.617    
 Estimated total run time in hh:mm:ss =      0 h 31 m 07 s
 We have done    36.13054     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        16000
 Time:    37.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.1069834E-06
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.5928309E-17
 Max of strain, epsilondev_crust_mantle  =  1.3693724E-10
 Elapsed time in seconds =    696.5248    
 Elapsed time in hh:mm:ss =      0 h 11 m 36 s
 Mean elapsed time per time step in seconds =   4.3532800E-02
 Time steps done =        16000  out of        42900
 Time steps remaining =        26900
 Estimated remaining time in seconds =    1171.032    
 Estimated remaining time in hh:mm:ss =      0 h 19 m 31 s
 Estimated total run time in seconds =    1867.557    
 Estimated total run time in hh:mm:ss =      0 h 31 m 07 s
 We have done    37.29604     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #        16500
 Time:    38.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  9.8870680E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.6875025E-17
 Max of strain, epsilondev_crust_mantle  =  1.0501590E-10
 Elapsed time in seconds =    718.2583    
 Elapsed time in hh:mm:ss =      0 h 11 m 58 s
 Mean elapsed time per time step in seconds =   4.3530807E-02
 Time steps done =        16500  out of        42900
 Time steps remaining =        26400
 Estimated remaining time in seconds =    1149.213    
 Estimated remaining time in hh:mm:ss =      0 h 19 m 09 s
 Estimated total run time in seconds =    1867.472    
 Estimated total run time in hh:mm:ss =      0 h 31 m 07 s
 We have done    38.46154     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        17000
 Time:    39.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  9.4879749E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.2198501E-17
 Max of strain, epsilondev_crust_mantle  =  2.0824073E-10
 Elapsed time in seconds =    739.8865    
 Elapsed time in hh:mm:ss =      0 h 12 m 19 s
 Mean elapsed time per time step in seconds =   4.3522734E-02
 Time steps done =        17000  out of        42900
 Time steps remaining =        25900
 Estimated remaining time in seconds =    1127.239    
 Estimated remaining time in hh:mm:ss =      0 h 18 m 47 s
 Estimated total run time in seconds =    1867.125    
 Estimated total run time in hh:mm:ss =      0 h 31 m 07 s
 We have done    39.62704     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        17500
 Time:    40.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  6.3906464E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.4715872E-17
 Max of strain, epsilondev_crust_mantle  =  1.2093700E-10
 Elapsed time in seconds =    761.5336    
 Elapsed time in hh:mm:ss =      0 h 12 m 41 s
 Mean elapsed time per time step in seconds =   4.3516207E-02
 Time steps done =        17500  out of        42900
 Time steps remaining =        25400
 Estimated remaining time in seconds =    1105.312    
 Estimated remaining time in hh:mm:ss =      0 h 18 m 25 s
 Estimated total run time in seconds =    1866.845    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    40.79254     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        18000
 Time:    41.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  6.0880825E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    8.2402588E-17
 Max of strain, epsilondev_crust_mantle  =  4.4610326E-11
 Elapsed time in seconds =    783.1836    
 Elapsed time in hh:mm:ss =      0 h 13 m 03 s
 Mean elapsed time per time step in seconds =   4.3510199E-02
 Time steps done =        18000  out of        42900
 Time steps remaining =        24900
 Estimated remaining time in seconds =    1083.404    
 Estimated remaining time in hh:mm:ss =      0 h 18 m 03 s
 Estimated total run time in seconds =    1866.588    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    41.95804     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        18500
 Time:    43.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  6.3049134E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.4046449E-17
 Max of strain, epsilondev_crust_mantle  =  1.3734797E-10
 Elapsed time in seconds =    804.8184    
 Elapsed time in hh:mm:ss =      0 h 13 m 24 s
 Mean elapsed time per time step in seconds =   4.3503698E-02
 Time steps done =        18500  out of        42900
 Time steps remaining =        24400
 Estimated remaining time in seconds =    1061.490    
 Estimated remaining time in hh:mm:ss =      0 h 17 m 41 s
 Estimated total run time in seconds =    1866.309    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    43.12354     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        19000
 Time:    44.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.9217308E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.8353721E-17
 Max of strain, epsilondev_crust_mantle  =  9.6789028E-11
 Elapsed time in seconds =    826.4730    
 Elapsed time in hh:mm:ss =      0 h 13 m 46 s
 Mean elapsed time per time step in seconds =   4.3498579E-02
 Time steps done =        19000  out of        42900
 Time steps remaining =        23900
 Estimated remaining time in seconds =    1039.616    
 Estimated remaining time in hh:mm:ss =      0 h 17 m 19 s
 Estimated total run time in seconds =    1866.089    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    44.28904     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        19500
 Time:    45.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.5299688E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.7068708E-17
 Max of strain, epsilondev_crust_mantle  =  1.0103416E-11
 Elapsed time in seconds =    848.1312    
 Elapsed time in hh:mm:ss =      0 h 14 m 08 s
 Mean elapsed time per time step in seconds =   4.3493912E-02
 Time steps done =        19500  out of        42900
 Time steps remaining =        23400
 Estimated remaining time in seconds =    1017.758    
 Estimated remaining time in hh:mm:ss =      0 h 16 m 57 s
 Estimated total run time in seconds =    1865.889    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    45.45454     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        20000
 Time:    46.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  5.2606720E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.0692597E-17
 Max of strain, epsilondev_crust_mantle  =  8.2520615E-11
 Elapsed time in seconds =    869.7582    
 Elapsed time in hh:mm:ss =      0 h 14 m 29 s
 Mean elapsed time per time step in seconds =   4.3487914E-02
 Time steps done =        20000  out of        42900
 Time steps remaining =        22900
 Estimated remaining time in seconds =    995.8732    
 Estimated remaining time in hh:mm:ss =      0 h 16 m 35 s
 Estimated total run time in seconds =    1865.631    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    46.62005     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        20500
 Time:    47.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  4.4563276E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.1370131E-16
 Max of strain, epsilondev_crust_mantle  =  7.0048634E-11
 Elapsed time in seconds =    891.5169    
 Elapsed time in hh:mm:ss =      0 h 14 m 51 s
 Mean elapsed time per time step in seconds =   4.3488629E-02
 Time steps done =        20500  out of        42900
 Time steps remaining =        22400
 Estimated remaining time in seconds =    974.1453    
 Estimated remaining time in hh:mm:ss =      0 h 16 m 14 s
 Estimated total run time in seconds =    1865.662    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    47.78555     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        21000
 Time:    48.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6798923E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.0166142E-16
 Max of strain, epsilondev_crust_mantle  =  5.2935373E-12
 Elapsed time in seconds =    913.2396    
 Elapsed time in hh:mm:ss =      0 h 15 m 13 s
 Mean elapsed time per time step in seconds =   4.3487601E-02
 Time steps done =        21000  out of        42900
 Time steps remaining =        21900
 Estimated remaining time in seconds =    952.3785    
 Estimated remaining time in hh:mm:ss =      0 h 15 m 52 s
 Estimated total run time in seconds =    1865.618    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    48.95105     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        21500
 Time:    50.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6467503E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.8135643E-17
 Max of strain, epsilondev_crust_mantle  =  4.3014675E-11
 Elapsed time in seconds =    934.9331    
 Elapsed time in hh:mm:ss =      0 h 15 m 34 s
 Mean elapsed time per time step in seconds =   4.3485261E-02
 Time steps done =        21500  out of        42900
 Time steps remaining =        21400
 Estimated remaining time in seconds =    930.5846    
 Estimated remaining time in hh:mm:ss =      0 h 15 m 30 s
 Estimated total run time in seconds =    1865.518    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    50.11655     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #        22000
 Time:    51.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.5824687E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.0799635E-17
 Max of strain, epsilondev_crust_mantle  =  4.2929174E-11
 Elapsed time in seconds =    956.6455    
 Elapsed time in hh:mm:ss =      0 h 15 m 56 s
 Mean elapsed time per time step in seconds =   4.3483887E-02
 Time steps done =        22000  out of        42900
 Time steps remaining =        20900
 Estimated remaining time in seconds =    908.8132    
 Estimated remaining time in hh:mm:ss =      0 h 15 m 08 s
 Estimated total run time in seconds =    1865.459    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    51.28205     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        22500
 Time:    52.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6231796E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.3376373E-17
 Max of strain, epsilondev_crust_mantle  =  1.0035919E-11
 Elapsed time in seconds =    978.3132    
 Elapsed time in hh:mm:ss =      0 h 16 m 18 s
 Mean elapsed time per time step in seconds =   4.3480586E-02
 Time steps done =        22500  out of        42900
 Time steps remaining =        20400
 Estimated remaining time in seconds =    887.0039    
 Estimated remaining time in hh:mm:ss =      0 h 14 m 47 s
 Estimated total run time in seconds =    1865.317    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    52.44755     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        23000
 Time:    53.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.6717432E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.3091938E-17
 Max of strain, epsilondev_crust_mantle  =  1.7198128E-11
 Elapsed time in seconds =    999.9692    
 Elapsed time in hh:mm:ss =      0 h 16 m 39 s
 Mean elapsed time per time step in seconds =   4.3476924E-02
 Time steps done =        23000  out of        42900
 Time steps remaining =        19900
 Estimated remaining time in seconds =    865.1908    
 Estimated remaining time in hh:mm:ss =      0 h 14 m 25 s
 Estimated total run time in seconds =    1865.160    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    53.61305     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        23500
 Time:    54.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.4734981E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    7.5284679E-17
 Max of strain, epsilondev_crust_mantle  =  1.9608060E-11
 Elapsed time in seconds =    1021.613    
 Elapsed time in hh:mm:ss =      0 h 17 m 01 s
 Mean elapsed time per time step in seconds =   4.3472879E-02
 Time steps done =        23500  out of        42900
 Time steps remaining =        19400
 Estimated remaining time in seconds =    843.3739    
 Estimated remaining time in hh:mm:ss =      0 h 14 m 03 s
 Estimated total run time in seconds =    1864.987    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    54.77855     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        24000
 Time:    55.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.3007177E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9036688E-17
 Max of strain, epsilondev_crust_mantle  =  8.1379296E-12
 Elapsed time in seconds =    1043.724    
 Elapsed time in hh:mm:ss =      0 h 17 m 23 s
 Mean elapsed time per time step in seconds =   4.3488514E-02
 Time steps done =        24000  out of        42900
 Time steps remaining =        18900
 Estimated remaining time in seconds =    821.9329    
 Estimated remaining time in hh:mm:ss =      0 h 13 m 41 s
 Estimated total run time in seconds =    1865.657    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    55.94406     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        24500
 Time:    57.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.9444908E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.0989800E-17
 Max of strain, epsilondev_crust_mantle  =  3.3667405E-12
 Elapsed time in seconds =    1065.395    
 Elapsed time in hh:mm:ss =      0 h 17 m 45 s
 Mean elapsed time per time step in seconds =   4.3485519E-02
 Time steps done =        24500  out of        42900
 Time steps remaining =        18400
 Estimated remaining time in seconds =    800.1335    
 Estimated remaining time in hh:mm:ss =      0 h 13 m 20 s
 Estimated total run time in seconds =    1865.529    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    57.10956     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        25000
 Time:    58.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6223037E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.1239862E-17
 Max of strain, epsilondev_crust_mantle  =  3.0266371E-12
 Elapsed time in seconds =    1087.073    
 Elapsed time in hh:mm:ss =      0 h 18 m 07 s
 Mean elapsed time per time step in seconds =   4.3482937E-02
 Time steps done =        25000  out of        42900
 Time steps remaining =        17900
 Estimated remaining time in seconds =    778.3445    
 Estimated remaining time in hh:mm:ss =      0 h 12 m 58 s
 Estimated total run time in seconds =    1865.418    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    58.27506     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        25500
 Time:    59.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4445626E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.0182609E-17
 Max of strain, epsilondev_crust_mantle  =  3.0290219E-12
 Elapsed time in seconds =    1108.722    
 Elapsed time in hh:mm:ss =      0 h 18 m 28 s
 Mean elapsed time per time step in seconds =   4.3479290E-02
 Time steps done =        25500  out of        42900
 Time steps remaining =        17400
 Estimated remaining time in seconds =    756.5397    
 Estimated remaining time in hh:mm:ss =      0 h 12 m 36 s
 Estimated total run time in seconds =    1865.262    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    59.44056     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        26000
 Time:    60.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.9318139E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.1927740E-17
 Max of strain, epsilondev_crust_mantle  =  5.1444786E-12
 Elapsed time in seconds =    1130.371    
 Elapsed time in hh:mm:ss =      0 h 18 m 50 s
 Mean elapsed time per time step in seconds =   4.3475796E-02
 Time steps done =        26000  out of        42900
 Time steps remaining =        16900
 Estimated remaining time in seconds =    734.7410    
 Estimated remaining time in hh:mm:ss =      0 h 12 m 14 s
 Estimated total run time in seconds =    1865.112    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    60.60606     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        26500
 Time:    61.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  6.3254657E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.8906455E-17
 Max of strain, epsilondev_crust_mantle  =  7.8291089E-12
 Elapsed time in seconds =    1152.038    
 Elapsed time in hh:mm:ss =      0 h 19 m 12 s
 Mean elapsed time per time step in seconds =   4.3473128E-02
 Time steps done =        26500  out of        42900
 Time steps remaining =        16400
 Estimated remaining time in seconds =    712.9593    
 Estimated remaining time in hh:mm:ss =      0 h 11 m 52 s
 Estimated total run time in seconds =    1864.997    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    61.77156     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        27000
 Time:    62.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.1052539E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.9492642E-17
 Max of strain, epsilondev_crust_mantle  =  4.5207709E-12
 Elapsed time in seconds =    1173.714    
 Elapsed time in hh:mm:ss =      0 h 19 m 33 s
 Mean elapsed time per time step in seconds =   4.3470874E-02
 Time steps done =        27000  out of        42900
 Time steps remaining =        15900
 Estimated remaining time in seconds =    691.1869    
 Estimated remaining time in hh:mm:ss =      0 h 11 m 31 s
 Estimated total run time in seconds =    1864.901    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    62.93706     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #        27500
 Time:    64.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.1340690E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.6189262E-17
 Max of strain, epsilondev_crust_mantle  =  6.1316932E-12
 Elapsed time in seconds =    1195.401    
 Elapsed time in hh:mm:ss =      0 h 19 m 55 s
 Mean elapsed time per time step in seconds =   4.3469135E-02
 Time steps done =        27500  out of        42900
 Time steps remaining =        15400
 Estimated remaining time in seconds =    669.4247    
 Estimated remaining time in hh:mm:ss =      0 h 11 m 09 s
 Estimated total run time in seconds =    1864.826    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    64.10256     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        28000
 Time:    65.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.1267950E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    8.0235414E-17
 Max of strain, epsilondev_crust_mantle  =  1.4240404E-11
 Elapsed time in seconds =    1217.191    
 Elapsed time in hh:mm:ss =      0 h 20 m 17 s
 Mean elapsed time per time step in seconds =   4.3471113E-02
 Time steps done =        28000  out of        42900
 Time steps remaining =        14900
 Estimated remaining time in seconds =    647.7195    
 Estimated remaining time in hh:mm:ss =      0 h 10 m 47 s
 Estimated total run time in seconds =    1864.911    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    65.26807     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        28500
 Time:    66.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.0840326E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.2407014E-17
 Max of strain, epsilondev_crust_mantle  =  9.7889787E-12
 Elapsed time in seconds =    1238.892    
 Elapsed time in hh:mm:ss =      0 h 20 m 38 s
 Mean elapsed time per time step in seconds =   4.3469898E-02
 Time steps done =        28500  out of        42900
 Time steps remaining =        14400
 Estimated remaining time in seconds =    625.9666    
 Estimated remaining time in hh:mm:ss =      0 h 10 m 25 s
 Estimated total run time in seconds =    1864.859    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    66.43356     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        29000
 Time:    67.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.9858106E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.0053667E-17
 Max of strain, epsilondev_crust_mantle  =  4.1605656E-12
 Elapsed time in seconds =    1260.600    
 Elapsed time in hh:mm:ss =      0 h 21 m 00 s
 Mean elapsed time per time step in seconds =   4.3468978E-02
 Time steps done =        29000  out of        42900
 Time steps remaining =        13900
 Estimated remaining time in seconds =    604.2188    
 Estimated remaining time in hh:mm:ss =      0 h 10 m 04 s
 Estimated total run time in seconds =    1864.819    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    67.59907     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        29500
 Time:    68.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.0459103E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.2408147E-17
 Max of strain, epsilondev_crust_mantle  =  1.5899605E-11
 Elapsed time in seconds =    1282.290    
 Elapsed time in hh:mm:ss =      0 h 21 m 22 s
 Mean elapsed time per time step in seconds =   4.3467455E-02
 Time steps done =        29500  out of        42900
 Time steps remaining =        13400
 Estimated remaining time in seconds =    582.4639    
 Estimated remaining time in hh:mm:ss =      0 h 09 m 42 s
 Estimated total run time in seconds =    1864.754    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    68.76457     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        30000
 Time:    69.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6896132E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9634316E-17
 Max of strain, epsilondev_crust_mantle  =  1.3445833E-11
 Elapsed time in seconds =    1303.991    
 Elapsed time in hh:mm:ss =      0 h 21 m 43 s
 Mean elapsed time per time step in seconds =   4.3466356E-02
 Time steps done =        30000  out of        42900
 Time steps remaining =        12900
 Estimated remaining time in seconds =    560.7159    
 Estimated remaining time in hh:mm:ss =      0 h 09 m 20 s
 Estimated total run time in seconds =    1864.707    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    69.93007     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        30500
 Time:    71.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4759618E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5242915E-17
 Max of strain, epsilondev_crust_mantle  =  3.8475217E-12
 Elapsed time in seconds =    1325.619    
 Elapsed time in hh:mm:ss =      0 h 22 m 05 s
 Mean elapsed time per time step in seconds =   4.3462928E-02
 Time steps done =        30500  out of        42900
 Time steps remaining =        12400
 Estimated remaining time in seconds =    538.9403    
 Estimated remaining time in hh:mm:ss =      0 h 08 m 58 s
 Estimated total run time in seconds =    1864.560    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    71.09557     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        31000
 Time:    72.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5354743E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.4453700E-17
 Max of strain, epsilondev_crust_mantle  =  1.4089998E-11
 Elapsed time in seconds =    1347.311    
 Elapsed time in hh:mm:ss =      0 h 22 m 27 s
 Mean elapsed time per time step in seconds =   4.3461651E-02
 Time steps done =        31000  out of        42900
 Time steps remaining =        11900
 Estimated remaining time in seconds =    517.1937    
 Estimated remaining time in hh:mm:ss =      0 h 08 m 37 s
 Estimated total run time in seconds =    1864.505    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    72.26107     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        31500
 Time:    73.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4373949E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.0261382E-17
 Max of strain, epsilondev_crust_mantle  =  1.5006996E-11
 Elapsed time in seconds =    1369.048    
 Elapsed time in hh:mm:ss =      0 h 22 m 49 s
 Mean elapsed time per time step in seconds =   4.3461841E-02
 Time steps done =        31500  out of        42900
 Time steps remaining =        11400
 Estimated remaining time in seconds =    495.4650    
 Estimated remaining time in hh:mm:ss =      0 h 08 m 15 s
 Estimated total run time in seconds =    1864.513    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    73.42657     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        32000
 Time:    74.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.4823453E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.8106441E-17
 Max of strain, epsilondev_crust_mantle  =  2.9407687E-12
 Elapsed time in seconds =    1390.771    
 Elapsed time in hh:mm:ss =      0 h 23 m 10 s
 Mean elapsed time per time step in seconds =   4.3461606E-02
 Time steps done =        32000  out of        42900
 Time steps remaining =        10900
 Estimated remaining time in seconds =    473.7315    
 Estimated remaining time in hh:mm:ss =      0 h 07 m 53 s
 Estimated total run time in seconds =    1864.503    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    74.59207     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        32500
 Time:    75.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5448989E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    5.3807493E-17
 Max of strain, epsilondev_crust_mantle  =  1.0325407E-11
 Elapsed time in seconds =    1412.610    
 Elapsed time in hh:mm:ss =      0 h 23 m 32 s
 Mean elapsed time per time step in seconds =   4.3464918E-02
 Time steps done =        32500  out of        42900
 Time steps remaining =        10400
 Estimated remaining time in seconds =    452.0352    
 Estimated remaining time in hh:mm:ss =      0 h 07 m 32 s
 Estimated total run time in seconds =    1864.645    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    75.75758     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:21
 
 Time step #        33000
 Time:    76.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.5026299E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.6431245E-17
 Max of strain, epsilondev_crust_mantle  =  1.4845309E-11
 Elapsed time in seconds =    1434.515    
 Elapsed time in hh:mm:ss =      0 h 23 m 54 s
 Mean elapsed time per time step in seconds =   4.3470137E-02
 Time steps done =        33000  out of        42900
 Time steps remaining =         9900
 Estimated remaining time in seconds =    430.3543    
 Estimated remaining time in hh:mm:ss =      0 h 07 m 10 s
 Estimated total run time in seconds =    1864.869    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    76.92308     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        33500
 Time:    78.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.7366301E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.8237713E-17
 Max of strain, epsilondev_crust_mantle  =  6.8105742E-12
 Elapsed time in seconds =    1456.261    
 Elapsed time in hh:mm:ss =      0 h 24 m 16 s
 Mean elapsed time per time step in seconds =   4.3470476E-02
 Time steps done =        33500  out of        42900
 Time steps remaining =         9400
 Estimated remaining time in seconds =    408.6225    
 Estimated remaining time in hh:mm:ss =      0 h 06 m 48 s
 Estimated total run time in seconds =    1864.883    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    78.08858     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        34000
 Time:    79.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.8148696E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.0304515E-17
 Max of strain, epsilondev_crust_mantle  =  5.8239273E-12
 Elapsed time in seconds =    1477.931    
 Elapsed time in hh:mm:ss =      0 h 24 m 37 s
 Mean elapsed time per time step in seconds =   4.3468568E-02
 Time steps done =        34000  out of        42900
 Time steps remaining =         8900
 Estimated remaining time in seconds =    386.8703    
 Estimated remaining time in hh:mm:ss =      0 h 06 m 26 s
 Estimated total run time in seconds =    1864.802    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    79.25408     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        34500
 Time:    80.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.7216208E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.5062341E-17
 Max of strain, epsilondev_crust_mantle  =  1.3111979E-11
 Elapsed time in seconds =    1499.632    
 Elapsed time in hh:mm:ss =      0 h 24 m 59 s
 Mean elapsed time per time step in seconds =   4.3467585E-02
 Time steps done =        34500  out of        42900
 Time steps remaining =         8400
 Estimated remaining time in seconds =    365.1277    
 Estimated remaining time in hh:mm:ss =      0 h 06 m 05 s
 Estimated total run time in seconds =    1864.759    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    80.41958     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        35000
 Time:    81.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.7703754E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.0594006E-17
 Max of strain, epsilondev_crust_mantle  =  9.7628190E-12
 Elapsed time in seconds =    1521.293    
 Elapsed time in hh:mm:ss =      0 h 25 m 21 s
 Mean elapsed time per time step in seconds =   4.3465514E-02
 Time steps done =        35000  out of        42900
 Time steps remaining =         7900
 Estimated remaining time in seconds =    343.3776    
 Estimated remaining time in hh:mm:ss =      0 h 05 m 43 s
 Estimated total run time in seconds =    1864.671    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    81.58508     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        35500
 Time:    82.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.4324776E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9528612E-17
 Max of strain, epsilondev_crust_mantle  =  2.0309288E-12
 Elapsed time in seconds =    1542.983    
 Elapsed time in hh:mm:ss =      0 h 25 m 42 s
 Mean elapsed time per time step in seconds =   4.3464314E-02
 Time steps done =        35500  out of        42900
 Time steps remaining =         7400
 Estimated remaining time in seconds =    321.6359    
 Estimated remaining time in hh:mm:ss =      0 h 05 m 21 s
 Estimated total run time in seconds =    1864.619    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    82.75058     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        36000
 Time:    83.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.9918695E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.2856216E-17
 Max of strain, epsilondev_crust_mantle  =  1.0210126E-11
 Elapsed time in seconds =    1564.646    
 Elapsed time in hh:mm:ss =      0 h 26 m 04 s
 Mean elapsed time per time step in seconds =   4.3462399E-02
 Time steps done =        36000  out of        42900
 Time steps remaining =         6900
 Estimated remaining time in seconds =    299.8906    
 Estimated remaining time in hh:mm:ss =      0 h 04 m 59 s
 Estimated total run time in seconds =    1864.537    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    83.91608     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        36500
 Time:    85.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6190295E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.9144212E-17
 Max of strain, epsilondev_crust_mantle  =  1.1657282E-11
 Elapsed time in seconds =    1586.344    
 Elapsed time in hh:mm:ss =      0 h 26 m 26 s
 Mean elapsed time per time step in seconds =   4.3461479E-02
 Time steps done =        36500  out of        42900
 Time steps remaining =         6400
 Estimated remaining time in seconds =    278.1535    
 Estimated remaining time in hh:mm:ss =      0 h 04 m 38 s
 Estimated total run time in seconds =    1864.497    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    85.08159     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        37000
 Time:    86.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.2410680E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.5416487E-17
 Max of strain, epsilondev_crust_mantle  =  4.7385819E-12
 Elapsed time in seconds =    1608.082    
 Elapsed time in hh:mm:ss =      0 h 26 m 48 s
 Mean elapsed time per time step in seconds =   4.3461669E-02
 Time steps done =        37000  out of        42900
 Time steps remaining =         5900
 Estimated remaining time in seconds =    256.4239    
 Estimated remaining time in hh:mm:ss =      0 h 04 m 16 s
 Estimated total run time in seconds =    1864.506    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    86.24709     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        37500
 Time:    87.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3413834E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5043401E-17
 Max of strain, epsilondev_crust_mantle  =  6.2545594E-12
 Elapsed time in seconds =    1629.797    
 Elapsed time in hh:mm:ss =      0 h 27 m 09 s
 Mean elapsed time per time step in seconds =   4.3461267E-02
 Time steps done =        37500  out of        42900
 Time steps remaining =         5400
 Estimated remaining time in seconds =    234.6908    
 Estimated remaining time in hh:mm:ss =      0 h 03 m 54 s
 Estimated total run time in seconds =    1864.488    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    87.41259     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        38000
 Time:    88.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6888068E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    6.1429079E-17
 Max of strain, epsilondev_crust_mantle  =  1.3019766E-11
 Elapsed time in seconds =    1651.544    
 Elapsed time in hh:mm:ss =      0 h 27 m 31 s
 Mean elapsed time per time step in seconds =   4.3461688E-02
 Time steps done =        38000  out of        42900
 Time steps remaining =         4900
 Estimated remaining time in seconds =    212.9623    
 Estimated remaining time in hh:mm:ss =      0 h 03 m 32 s
 Estimated total run time in seconds =    1864.506    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    88.57809     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        38500
 Time:    89.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.7056839E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5440190E-17
 Max of strain, epsilondev_crust_mantle  =  9.6688681E-12
 Elapsed time in seconds =    1673.259    
 Elapsed time in hh:mm:ss =      0 h 27 m 53 s
 Mean elapsed time per time step in seconds =   4.3461282E-02
 Time steps done =        38500  out of        42900
 Time steps remaining =         4400
 Estimated remaining time in seconds =    191.2296    
 Estimated remaining time in hh:mm:ss =      0 h 03 m 11 s
 Estimated total run time in seconds =    1864.489    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    89.74359     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        39000
 Time:    90.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.0423397E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.1916516E-17
 Max of strain, epsilondev_crust_mantle  =  2.1144579E-12
 Elapsed time in seconds =    1694.957    
 Elapsed time in hh:mm:ss =      0 h 28 m 14 s
 Mean elapsed time per time step in seconds =   4.3460444E-02
 Time steps done =        39000  out of        42900
 Time steps remaining =         3900
 Estimated remaining time in seconds =    169.4957    
 Estimated remaining time in hh:mm:ss =      0 h 02 m 49 s
 Estimated total run time in seconds =    1864.453    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    90.90909     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        39500
 Time:    92.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.6136023E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    1.7700363E-17
 Max of strain, epsilondev_crust_mantle  =  1.3121775E-11
 Elapsed time in seconds =    1716.847    
 Elapsed time in hh:mm:ss =      0 h 28 m 36 s
 Mean elapsed time per time step in seconds =   4.3464474E-02
 Time steps done =        39500  out of        42900
 Time steps remaining =         3400
 Estimated remaining time in seconds =    147.7792    
 Estimated remaining time in hh:mm:ss =      0 h 02 m 27 s
 Estimated total run time in seconds =    1864.626    
 Estimated total run time in hh:mm:ss =      0 h 31 m 04 s
 We have done    92.07459     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        40000
 Time:    93.33100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3403224E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.6353470E-17
 Max of strain, epsilondev_crust_mantle  =  1.3655480E-11
 Elapsed time in seconds =    1739.000    
 Elapsed time in hh:mm:ss =      0 h 28 m 59 s
 Mean elapsed time per time step in seconds =   4.3475002E-02
 Time steps done =        40000  out of        42900
 Time steps remaining =         2900
 Estimated remaining time in seconds =    126.0775    
 Estimated remaining time in hh:mm:ss =      0 h 02 m 06 s
 Estimated total run time in seconds =    1865.078    
 Estimated total run time in hh:mm:ss =      0 h 31 m 05 s
 We have done    93.24010     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        40500
 Time:    94.49767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.6934492E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.6274924E-17
 Max of strain, epsilondev_crust_mantle  =  2.3565572E-12
 Elapsed time in seconds =    1762.067    
 Elapsed time in hh:mm:ss =      0 h 29 m 22 s
 Mean elapsed time per time step in seconds =   4.3507826E-02
 Time steps done =        40500  out of        42900
 Time steps remaining =         2400
 Estimated remaining time in seconds =    104.4188    
 Estimated remaining time in hh:mm:ss =      0 h 01 m 44 s
 Estimated total run time in seconds =    1866.486    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    94.40559     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        41000
 Time:    95.66433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.3808531E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    4.1803203E-17
 Max of strain, epsilondev_crust_mantle  =  1.1657781E-11
 Elapsed time in seconds =    1784.123    
 Elapsed time in hh:mm:ss =      0 h 29 m 44 s
 Mean elapsed time per time step in seconds =   4.3515198E-02
 Time steps done =        41000  out of        42900
 Time steps remaining =         1900
 Estimated remaining time in seconds =    82.67888    
 Estimated remaining time in hh:mm:ss =      0 h 01 m 22 s
 Estimated total run time in seconds =    1866.802    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    95.57110     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        41500
 Time:    96.83100      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  2.2518162E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.0644229E-17
 Max of strain, epsilondev_crust_mantle  =  1.6239173E-11
 Elapsed time in seconds =    1805.895    
 Elapsed time in hh:mm:ss =      0 h 30 m 05 s
 Mean elapsed time per time step in seconds =   4.3515544E-02
 Time steps done =        41500  out of        42900
 Time steps remaining =         1400
 Estimated remaining time in seconds =    60.92176    
 Estimated remaining time in hh:mm:ss =      0 h 01 m 00 s
 Estimated total run time in seconds =    1866.817    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    96.73660     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        42000
 Time:    97.99767      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2244861E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.8998618E-17
 Max of strain, epsilondev_crust_mantle  =  6.4895238E-12
 Elapsed time in seconds =    1827.630    
 Elapsed time in hh:mm:ss =      0 h 30 m 27 s
 Mean elapsed time per time step in seconds =   4.3514997E-02
 Time steps done =        42000  out of        42900
 Time steps remaining =          900
 Estimated remaining time in seconds =    39.16350    
 Estimated remaining time in hh:mm:ss =      0 h 00 m 39 s
 Estimated total run time in seconds =    1866.793    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    97.90210     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        42500
 Time:    99.16433      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  3.2135455E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    3.7734256E-17
 Max of strain, epsilondev_crust_mantle  =  8.8989987E-12
 Elapsed time in seconds =    1849.296    
 Elapsed time in hh:mm:ss =      0 h 30 m 49 s
 Mean elapsed time per time step in seconds =   4.3512855E-02
 Time steps done =        42500  out of        42900
 Time steps remaining =          400
 Estimated remaining time in seconds =    17.40514    
 Estimated remaining time in hh:mm:ss =      0 h 00 m 17 s
 Estimated total run time in seconds =    1866.702    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    99.06760     % of that
 The run will finish approximately on (in local time): Mon Oct 28, 2024 19:20
 
 Time step #        42900
 Time:    100.0977      minutes
 Max norm displacement vector U in solid in all slices for forward prop. (m) = 
  1.4866886E-07
 Max non-dimensional potential Ufluid in fluid in all slices for forward prop. =
    2.5097474E-17
 Max of strain, epsilondev_crust_mantle  =  1.6404980E-11
 Elapsed time in seconds =    1866.610    
 Elapsed time in hh:mm:ss =      0 h 31 m 06 s
 Mean elapsed time per time step in seconds =   4.3510735E-02
 Time steps done =        42900  out of        42900
 Time steps remaining =            0
 Estimated remaining time in seconds =   0.0000000E+00
 Estimated remaining time in hh:mm:ss =      0 h 00 m 00 s
 Estimated total run time in seconds =    1866.610    
 Estimated total run time in hh:mm:ss =      0 h 31 m 06 s
 We have done    100.0000     % of that
 
 Writing the seismograms
 Total number of time steps written:        42900
 Writing the seismograms in parallel took   0.3634711      seconds
 
 Time-Loop Complete. Timing info:
 Total elapsed time in seconds =    1867.017    
 Total elapsed time in hh:mm:ss =      0 h 31 m 07 s
 
 finalizing simulation
 
 End of the simulation
 

[dosoe]

and here is the plot, it seems it didn't come over

[danielpeter]

not too bad - there are two differences in the setup:

1. DT:
   the old version uses DT = 0.1425
   the new DT = 0.142

to use the same DT in the new version you can just add a line in the Par_file with

DT                  =   0.1425d0

having a different DT can affect the stability regime and accuracy of the solution. just to be safe, it's good to compare the solutions with the same DT value set.

2. start time:
   the old version has start time : -3.300000 seconds
   and the new start time : 0.0000000E+00 seconds

this is something I missed in the old source setup, where the start time is only set to zero for force source solutions. the different start time will affect the length of the seismograms, although the source time function values are set to zero for times < 0. I'm not sure how much this would affect the filtering of the traces. anyway, I added this change to the updated devel version now as well (SPECFEM/specfem3d_globe#852).

use git pull on your local devel version and re-compile (no need to run the configure script again, just run make all after pulling the most recent source files). then, add the DT = .. line in the Par_file and you should be all set for another round of comparisons :)

[dosoe]

Hi Daniel,
I did a new round of comparisons. The results is that the topography fits perfectly now, but the attenuation doesn't.
Here are the corresponding plots, First ellipticity and Topography:

Here is ellipticity and attenuation:

and here is with all flags activated:

I can upload the output files again, but the only thing I changed compared to last runs is the flags (for attenuation and topography) and the timestep, else I just pulled your code. The compilers on the cluster changed too, I went from OpenMPI to IntelMPI, but I don't expect that to make a difference, especially since the results look very similar to those on the previous OpenMPI runs. In the documentation, I see mentions of potential problems when using ifort (which I have been doing from the beginning), but no mention of intelMPI.

[danielpeter]

thanks Dorian, it looks like we're doing small steps towards a perfect fit...

so based on your figures above, it seems that the main differences are still from attenuation. there must be a small discrepancy probably of the relaxation times between new and old version. given the traces only start differing at larger epicentral distances, these values must be only slightly different which might be due to difference floating point precisions. I'll try to find out more about that.

in the meantime, could you attach the output_mesher.txt and output_solver.txt from that updated attenuation run?