Challenge problems¶

Overview¶

The reliability problems – grouped into different sets – are summarized in the tables below. The sets are established to represent distinctively different problems where different methods are expected to excel, e.g. reliability problems with a single design point, or reliability problems with continuous and differentiable performance function. Sets and problems are identified with their set_id and problem_id, respectively; both are integers.

You can download all of the probabilistic models from the GitLab repository in a tabular format by clicking on this link.

Problem sets¶

Tutorial set¶

To help the understanding and verification purposes all details are disclosed for the first two problems in this set. Problem 3 exemplifies what information will be provided during the challenge for each reliability problems. Since these problems serve testing, no upper limit on the number of performance function evaluations is enforced. Use username: 'testuser' and password: 'testpass' for testing (only available for the tutorial).

 username ‘testuser’ password ‘testpass’
Table 6 – Tutorial set.
set_id problem_id Reliability problem Max evaluations
-1 1 RP8 $$\infty$$
-1 2 RP22 $$\infty$$
-1 3 RP33 $$\infty$$

Challenge set 1 - single performance function¶

Reliability problems in this set have a single performance function but nothing else is disclosed about them. Once the challenge is open (Timeline) you can register and use your username and password to access these problems.

Evaluating the performance function yields a component and a system performance function value. These are equal as we have only a single performance function.

Note

Some of the performance functions rely on iterative numerical algorithms which might fail to converge under certain inputs; similarly as a finite element analysis. In those cases NaN values are returned. Make sure that your reliability algorithm can handle these cases. The performance functions will not yield NaN values for reasonable input points that do not correspond to failure.

Table 7 – Challenge set 1.
set_id problem_id Reliability problem Max evaluations
1 1 RP14 10000
1 2 RP24 10000
1 3 RP28 10000
1 4 RP31 10000
1 5 RP38 10000
1 6 RP53 10000
1 7 RP54 10000
1 8 RP63 10000
1 9 RP75 10000
1 10 RP107 10000
1 11 RP111 10000
1 12 RP201 10000
1 13 RP203 10000
1 14 RP213 10000
1 15 RP300 10000
1 16 RP301 10000

Challenge set 2 - Multiple, known number of performance functions¶

Reliability problems in this set have unknown number of performance functions. Once the challenge is open (Timeline) you can register and use your username and password to access these problems.

Evaluating the performance function yields performance function values for each component and the system as well. However, how the system performance function is calculated is not revealed, you test the RP33 system problem from the tutorial set.

Note

Some of the performance functions rely on iterative numerical algorithms which might fail to converge under certain inputs; similarly as a finite element analysis. In those cases NaN values are returned. Make sure that your reliability algorithm can handle these cases.

Table 8 – Challenge set 2.
set_id problem_id Reliability problem Max evaluations
2 1 RP25 10000
2 2 RP33 10000
2 3 RP35 10000
2 4 RP55 10000
2 5 RP57 10000
2 6 RP60 10000
2 7 RP77 10000
2 8 RP89 10000
2 9 RP91 10000
2 10 RP110 10000
2 11 RP202 10000