Commit graph

23 commits

Author SHA1 Message Date
Alexander Vasilyev
a56f50ac46 Calculate coverage of private code.
Create empty coverage profile from problem code to calculate coverage
correctly. For some wierd reasons it will also account for not tested packages.
This change prevents students from adding new code and testing it,
instead of getting good coverage for initial codebase :)
2020-03-27 22:32:10 +03:00
Alexander Vasilyev
54ab7b69d1 Add coverpkg specification.
Currently, packages in coverme without tests created by student
are not checked for coverage, because no there are no test targets
for them at all!

The issue can be fixed by simply creating empty !change files,
but we are engineers, aren't we? :)

Bonus point: it prevents new packages from giving false coverage credit.
For example, mock file generated by gomock will have lots of covered code
almost instantly. However, the task can be hacked by adding new code to
existing packages.
2020-03-27 22:32:10 +03:00
Alexander Vasilyev
545ce5cbe3 Calculate coverage problem-wise, not per package.
This seems to be fair, especially since coverage target is
defined problem-wise. Practical reason: coverme/app can not
be covered sufficiently without testing Start/initRoutes/run;
out of these, only initRoutes can be tested, and testing it
separately is a wierd solution.
2020-03-27 22:32:10 +03:00
Arseny Balobanov
5f1b033f10 testtool: fix cover profile permissions issue by writing profile to /tmp. 2020-03-20 13:00:17 +03:00
Arseny Balobanov
a74e207ea3 testtool: fix coverage comment search dir. 2020-03-20 11:59:20 +03:00
Arseny Balobanov
cd7f4d69f1 Support test coverage requirements via comment. 2020-03-19 01:19:44 +03:00
Fedor Korotkiy
b7c84cb10a Fix error message 2020-02-22 15:37:16 +03:00
Fedor Korotkiy
e2f472d732 Compare benchmarks 2020-02-22 01:23:20 +03:00
Fedor Korotkiy
8eddf48fa9 Run linter on submit 2020-02-14 15:55:25 +03:00
Fedor Korotkiy
d842678a2c Fix 2020-02-13 03:07:21 +03:00
Fedor Korotkiy
d4a0cca74d Debugging 2020-02-13 03:02:31 +03:00
Fedor Korotkiy
d09d084a1d Debugging 2020-02-13 02:58:32 +03:00
Fedor Korotkiy
796804edab Debugging 2020-02-13 02:50:16 +03:00
Fedor Korotkiy
e227b7e140 Fix 2020-02-13 02:31:40 +03:00
Fedor Korotkiy
6a83a4f1fc Task grading 2020-02-13 02:10:17 +03:00
verytable
dea434be37 Resolve "word-count" 2020-02-12 22:25:12 +00:00
Fedor Korotkiy
0de2390008 Squashed commit of the following:
commit 347ba11cfe4a49bff6fc29063b49416d90525e52
Author: Fedor Korotkiy <prime@yandex-team.ru>
Date:   Sat Feb 8 22:44:26 2020 +0300

    Sandboxed test execution.

commit c5c9557dd59c54971a78d424ec118655f6b2005c
Author: Fedor Korotkiy <prime@yandex-team.ru>
Date:   Sat Feb 8 21:13:13 2020 +0300

    Fix paths used during testing.

commit 1ba21eb0aad08f543c6a99bfd927721207943abb
Author: Fedor Korotkiy <prime@yandex-team.ru>
Date:   Sat Feb 8 20:56:32 2020 +0300

    Helper for process sandboxing

commit 54f0aa11156c1d2c998a060b60be7af8666d5da4
Author: Fedor Korotkiy <prime@yandex-team.ru>
Date:   Sat Feb 8 20:10:56 2020 +0300

    Package list helper.
2020-02-10 16:41:58 +03:00
verytable
664f66105b Use cmd.Run instead of cmd.Start+cmd.Wait. 2020-02-02 01:21:12 +03:00
verytable
ff809b73c3 Start doc comments with the name being declared. 2020-02-02 01:19:13 +03:00
Fedor Korotkiy
dc2f940fc0 Fix running tests under goland 2020-02-01 04:29:29 +03:00
Fedor Korotkiy
f2da93215a Working on export tool 2020-02-01 03:23:20 +03:00
verytable
afe8fcdc4d Remove duplicate word from comment. 2020-01-31 23:13:31 +03:00
verytable
ff1e12f5e4 Adding testtool - the submission tester. 2020-01-29 01:42:19 +03:00