Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Silent faults / SDC by hinojosa #41

Closed
wants to merge 45 commits into from
Closed
Changes from 1 commit
Commits
Show all changes
45 commits
Select commit Hold shift + click to select a range
313381b
Added some missing files
Aug 15, 2016
4c464f4
Added soft fault detection functions to clean sg++ 2.0.0
Aug 15, 2016
43f9d1e
Fixed gsl_matrix_set.Results identical to Python.
Aug 15, 2016
3dab285
Changed tuning constant in regression. Seems more robust
Aug 19, 2016
c625585
Recover scheme after detecting SDC
Sep 2, 2016
ce8f309
Doing robust regression with Python functions
Sep 30, 2016
0664336
SDC detection works but failed tasks are not reset correctly
Oct 29, 2016
4dae9f4
Distributed SDC detection working
Nov 3, 2016
2ee98e9
GSL implementation finished, but optimization not working optimally d…
Nov 4, 2016
73aabed
Last changes before testing with Hazelhen
Nov 6, 2016
d8453df
Removed random fault generation
Nov 6, 2016
3a066a3
Removed random fault generation from Manager
Nov 6, 2016
b679aa8
Using studentized residuals from GSL directly without normalization -…
Nov 12, 2016
de760f9
Removed Python functions
Nov 14, 2016
d0d5560
Holy crap it worked out of the box. The compare values thing I mean. …
Nov 15, 2016
8da80f5
Refactored code; compareValues function seems to be working
Nov 16, 2016
5d7f99a
Minor changes before merge with hazel hen branch
Nov 18, 2016
41776ca
Changes to scons files.
Nov 18, 2016
270c044
SDC method can be specified from params file
Nov 21, 2016
8d801a5
I'm not sure what I changed here
Nov 21, 2016
bc35c0b
Resolved conflict in PGW
Nov 21, 2016
c0f7650
Moved high value detection before robust regression
Nov 27, 2016
eba0020
Now specifying vector index where SDC is to be injected
Nov 28, 2016
cc52271
Fixed fault recognition when fault hits lower diagonals
Dec 1, 2016
897f941
With strategy switch for small number of measurements.
Dec 6, 2016
6e72ad2
Minor fixes
Dec 6, 2016
ea9d172
Merge branch 'silent-faults' of ssh://localhost:9999/heenemo/combi in…
Dec 6, 2016
7857a5f
Removed local_rank_faults from sdcInfo struct
Dec 7, 2016
a855c43
Merge branch 'silent-faults' of ssh://localhost:9999/heenemo/combi in…
Dec 7, 2016
13909c5
Assuming only one outlier
Dec 13, 2016
0830732
Correct initialization of weight vector
Dec 13, 2016
7457028
Added check by varying combicoefficients of suspicious function values
Dec 15, 2016
486ef69
Checking only one value
Dec 16, 2016
8cc99fd
Merge branch 'silent-faults' of ssh://localhost:9999/heenemo/combi in…
Dec 16, 2016
a49a3ff
Fixed function combineValuesFaults for the case when we use many grou…
Dec 30, 2016
77120c7
Assuming many outliers can occur
Dec 30, 2016
1d742a0
Merge branch 'silent-faults' of ssh://localhost:9999/heenemo/combi in…
Dec 30, 2016
1e55b90
Fixed bug in iteration of faults
Dec 30, 2016
58eb2e3
Merge branch 'silent-faults' of ssh://localhost:9999/heenemo/combi in…
Dec 30, 2016
6e97c51
Removed debugging code and documented functions.
Jan 17, 2017
8f474b6
Delete .gitlab-ci.yml
Mar 15, 2017
ec4bc48
Fixed conflict in ProcessGroupWorker
Apr 5, 2017
c890cd4
distributedcombigrid/src/sgpp/distributedcombigrid/manager/ProcessGro…
Apr 5, 2017
14de4dd
Added combi_example_soft_faults
Apr 5, 2017
bcf9de5
Added GSL package with adapted robust regression.
Apr 5, 2017
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Assuming many outliers can occur
Alfredo Hinojosa committed Dec 30, 2016
commit 77120c7dfd7d9b1826d126e4736a06831e65db92
Original file line number Diff line number Diff line change
@@ -719,26 +719,26 @@ void ProcessGroupWorker::computeLMSResiduals( gsl_multifit_robust_workspace* reg
gsl_vector_set(r_stand, i, fabs(gsl_vector_get(r_stand, i)));

// Largest standardized residual
double r_max = gsl_vector_max(r_stand);
size_t r_max_index = gsl_vector_max_index(r_stand);
// double r_max = gsl_vector_max(r_stand);
// size_t r_max_index = gsl_vector_max_index(r_stand);

// Threshold for residuals
double eps = 2.5;

// Weight for max residual: here we assume that there can
// only be one outlier (the one with the largest residual)
gsl_vector_set_all( weights, 1 );
if(r_max > eps)
gsl_vector_set(weights, r_max_index, 0);
// gsl_vector_set_all( weights, 1 );
// if(r_max > eps)
// gsl_vector_set(weights, r_max_index, 0);

// Weights for each residual: here we assume that the can
// be multiple residuals
//for(size_t i = 0; i < r_stand->size; ++i){
// if(std::abs(r_stand->data[i]) <= eps)
// gsl_vector_set(weights, i, 1);
// else
// gsl_vector_set(weights, i, 0);
//}
for(size_t i = 0; i < r_stand->size; ++i){
if(std::abs(r_stand->data[i]) <= eps)
gsl_vector_set(weights, i, 1);
else
gsl_vector_set(weights, i, 0);
}

// Robust scale estimate
double prod;