CIP - calculations in parallel

Difference between version 2 and 3 - Previous - Next
[Arjen Markus] (7 january 2023) The break during the holiday season allowed me to pick up an old project again: a way to define a bunch of calculations and have them run partly simultaneously and partly sequentially, so that you use the computing resources efficiently. The main steering program was complete and even documented, but I thought it would be nice to have some more supporting programs:

   * A program to prepare the input files based on a simple table
   * A program to report on the variations
   * Various modes for the first program that the reporting program should act upon

Well, I was able to finish a lot of what I had in mind with the exception of the additional documentation. So, this page is mostly a placeholder :) at this moment. But I wanted to publish it now.


[saito] (6 january 2023) Sounds interesting.  I can see how it relates to some of the previous comments on the [Tasks] page.  It might be helpful to show a specific use case where this is used to solve a problem for you.  Not necessarily the code you have developed but its usage, as in: calculation-a does this, calculation-b does this, this is how they are related and/or how they vary, and here is how they should all fit together, using your terminology above.
----
'''[arjen] - 2023-01-08 10:33:38'''

A quick answer to your question: one application of this would be the Morris method for examining the sensitivity of parameters in a numerical model. The idea is to run a set of simulations, each with a slightly different value for a parameter (but the variation accumulates). The set of programs I have makes this very easy, including the subsequent overview of the result: you can simply specify what parameters to change and the "cip-prepare" program generates the input. There are of course a bunch of conventions, but they should be straightforward to meet.----
'''[arjen] - 2023-01-08 15:35:40'''

I published the code with documentation and an example in its current incomplete state on Github - https://github.com/arjenmarkus/cip-git.