Results¶

Thank you everyone who participated in, contributed to, and/or was interested in the Black-box Reliability Challenge 2019. As a first step of disseminating the results we:

made all reference solutions and performance functions public, see Reliability problems;
summarize the main results in the plots below (participants are anonymized) (Visual summary).

If you use some code or results from this website please cite us (Citation).

If you have any suggestions and/or questions regarding the results or about the reliability challenge in general, do not hestitate to Contact us.

Visual summary¶

Note

To zoom into the images open them in a new tab or download them.

_images/beta_final_submission.facet.hidden_username.png

Fig. 1 Comparison of submitted system reliability indices to reference solutions (horizonatal black lines).

_images/beta_vs_num_eval.facet.set1.hidden_username.png

Fig. 2 Set 1. Submitted system reliability indices and corresponding number of performance function evaluations in comparison to reference solutions (horizonatal black lines).

_images/beta_vs_num_eval.facet.set2.hidden_username.png

Fig. 3 Set 2. Submitted system reliability indices and corresponding number of performance function evaluations in comparison to reference solutions (horizonatal black lines).

Next steps¶

We are in a process of organizing a follow-up workshop that planned to take place in early 2020 in Delft, The Netherlands. We hope that the participants would share the details of their reliability algorithms and their experience for the benefit of the reliability community.