Hi Ned, it seems that we are no longer seeing the error message strings when a solution fails. This makes it kind of hard to debug when not working from a computer. Any ideas if this could be fixed?
If the great Alfonso is having problems, there must be something really wrong. I'm not sure if this is directly related, but I can no longer use the "Test reference solution" when working on a problem to publish (it hasn't worked for many weeks now). I just have to rely on my local computer passing the solution as good enough, which is almost always good enough. However, I have published some problems in the past with such large test cases that the Cody servers lock up or time out. Therefore, I am reticent to publish certain types of problems until these bugs are fixed. For what it's worth, these problems might have correlated with the server fixes to prevent future spam problems from appearing.
Speaking of this kind of problems, some solutions are now unreachable. Here is an example problem 1653 where there are 15 solvers, 28 solutions but only one solution visible. In consequences Cody claims that I've solved this problem and at the same time is showing it in unsolved ones. As far as I know it is not the only one case. There are also couple of minor errors with recent activity pages where many valuable comments disappeared, same with likes and badges counters. As Grant mentioned above most of those issues looks like consequences after recent spammers attack. Anyway, what is missing the most is the things mentioned by colleagues.
Sorry for messing things up here, but there is one more thing coming to my mind. There are many valuable problems that became unsolvable due to the changes between versions of Matlab and lack of support from creators (long inactivity on Cody, etc.). Maybe there would be possibility to give some editorial privileges to "trusted" users to refresh those problems or repair incorrect testsuites? (but what about affecting previous solutions?)
I personally think that there should be an approval mechanism for every submitted problem.
I agree with Jan and rifat. I discussed this with Ned via email a while back, and I realized that requiring that the individual submit a solution along with the problem might prevent people from posting problems. But, requiring that the problem pass the reference solution, rather than just being a nicety, would solve a lot of these problems. (There hasn't been a lot of activity on Cody in the past few months, anyway.) I just hope that they fix my account, though, before implementing such a measure, since it would block me out at the moment (see comment above). The sheer number of problems with broken test suites is rather annoying. And, as mentioned above, there are a few problems that I would like to solve but that are no longer solvable with the current server/Matlab version.
Test  Status  Code Input and Output 

1  Fail 
%%
ABCD = 70;
ABC = 65;
AB = 40;
BC = 52;
y = combined_ages_nonsymmetric_w_mult(ABCD,ABC,AB,BC);
y_correct = [13;27;25;5];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

2  Fail 
%%
ABCC = 98;
BBC = 84;
AAB = 70;
y = combined_ages_nonsymmetric_w_mult(ABCC,BBC,AAB);
y_correct = [20;30;24];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

3  Fail 
%%
ABCDA = 150;
ABCB = 99;
BCDB = 91;
ABDAD = 135;
y = combined_ages_nonsymmetric_w_mult(ABCDA,ABCB,BCDB,ABDAD);
y_correct = [35;11;42;27];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

4  Fail 
%%
ABBA = 90;
BCC = 113;
ABCBA = 141;
y = combined_ages_nonsymmetric_w_mult(ABBA,BCC,ABCBA);
y_correct = [34;11;51];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

5  Fail 
%%
ABCDE = 120;
ABCDD = 111;
ABCCC = 87;
ABBBB = 66;
AAAAA = 50;
y = combined_ages_nonsymmetric_w_mult(ABCDE,ABCDD,ABCCC,ABBBB,AAAAA);
y_correct = [10,14,21,33,42];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

6  Fail 
%%
ABC = 45;
BEA = 66;
CAE = 73;
DAB = 57;
AAD = 53;
y = combined_ages_nonsymmetric_w_mult(ABC,BEA,CAE,DAB,AAD);
y_correct = [10,14,21,33,42];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

7  Fail 
%%
ABCABC = 144;
BEAB = 107;
CAEAD = 147;
DABB = 73;
AADAA = 133;
y = combined_ages_nonsymmetric_w_mult(ABCABC,BEAB,CAEAD,DABB,AADAA);
y_correct = [30,15,27,13,47];
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

8  Fail 
%% anticheating test case
ind = randi(4);
switch ind
case 1
ABCC = 98;
BBC = 84;
AAB = 70;
y = combined_ages_nonsymmetric_w_mult(ABCC,BBC,AAB);
y_correct = [20;30;24];
case 2
ABCDA = 150;
ABCB = 99;
BCDB = 91;
ABDAD = 135;
y = combined_ages_nonsymmetric_w_mult(ABCDA,ABCB,BCDB,ABDAD);
y_correct = [35;11;42;27];
case 3
ABCABC = 144;
BEAB = 107;
CAEAD = 147;
DABB = 73;
AADAA = 133;
y = combined_ages_nonsymmetric_w_mult(ABCABC,BEAB,CAEAD,DABB,AADAA);
y_correct = [30,15,27,13,47];
case 4
ABCD = 70;
ABC = 65;
AB = 40;
BC = 52;
y = combined_ages_nonsymmetric_w_mult(ABCD,ABC,AB,BC);
y_correct = [13;27;25;5];
end
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

9  Fail 
%% anticheating test case
ind = randi(4);
switch ind
case 1
ABCC = 98;
BBC = 84;
AAB = 70;
y = combined_ages_nonsymmetric_w_mult(ABCC,BBC,AAB);
y_correct = [20;30;24];
case 2
ABCABC = 144;
BEAB = 107;
CAEAD = 147;
DABB = 73;
AADAA = 133;
y = combined_ages_nonsymmetric_w_mult(ABCABC,BEAB,CAEAD,DABB,AADAA);
y_correct = [30,15,27,13,47];
case 3
ABCD = 70;
ABC = 65;
AB = 40;
BC = 52;
y = combined_ages_nonsymmetric_w_mult(ABCD,ABC,AB,BC);
y_correct = [13;27;25;5];
case 4
ABC = 45;
BEA = 66;
CAE = 73;
DAB = 57;
AAD = 53;
y = combined_ages_nonsymmetric_w_mult(ABC,BEA,CAE,DAB,AAD);
y_correct = [10,14,21,33,42];
end
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

10  Fail 
%% anticheating test case
ind = randi(4);
switch ind
case 1
ABBA = 90;
BCC = 113;
ABCBA = 141;
y = combined_ages_nonsymmetric_w_mult(ABBA,BCC,ABCBA);
y_correct = [34;11;51];
case 2
ABCD = 70;
ABC = 65;
AB = 40;
BC = 52;
y = combined_ages_nonsymmetric_w_mult(ABCD,ABC,AB,BC);
y_correct = [13;27;25;5];
case 3
ABCDA = 150;
ABCB = 99;
BCDB = 91;
ABDAD = 135;
y = combined_ages_nonsymmetric_w_mult(ABCDA,ABCB,BCDB,ABDAD);
y_correct = [35;11;42;27];
case 4
ABCC = 98;
BBC = 84;
AAB = 70;
y = combined_ages_nonsymmetric_w_mult(ABCC,BBC,AAB);
y_correct = [20;30;24];
end
for i = 1:numel(y_correct)
assert(isequal(y(i),y_correct(i)))
end

1266 Solvers
42 Solvers
First nonzero element in each column
588 Solvers
698 Solvers
145 Solvers