Commit Graph

1136 Commits (c61550e96732682e0d32bc62fe4d5c8ea61ba782)

Author SHA1 Message Date
Medya Ghazizadeh 5501afa9ef
Merge pull request #11683 from andriyDev/FixNoFlakesComment
Fix flake rates being commented about when no failed tests are present.
2021-06-17 17:58:44 -04:00
Medya Ghazizadeh 7d9bcf8626
Merge pull request #11684 from andriyDev/ChangeFlakeColors
Update flake chart colors
2021-06-17 13:00:46 -04:00
Medya Ghazizadeh 3c01c8a152
Merge pull request #11675 from andriyDev/FixReportFlakes
Stop using sudo for check_install_gh
2021-06-17 13:00:04 -04:00
Andriy Dzikh 300230bd5c Update flake chart colors. 2021-06-17 09:41:40 -07:00
Andriy Dzikh 5b8b5ce102 Fix flake rates being commented about when no failed tests are present. 2021-06-17 09:28:27 -07:00
Andriy Dzikh 9f601ea393 Fix commenting to a PR instead of an issue. 2021-06-16 18:03:52 -07:00
Andriy Dzikh c037e5f62f Stop using sudo for check_install_gh. 2021-06-16 15:29:50 -07:00
Steven Powell 8f019e0418
Merge pull request #11659 from spowelljr/updateTimeToK8s
Create automated time-to-k8s benchmarks on release
2021-06-16 20:04:11 +00:00
Steven Powell 25c5bec652 change back iterations to 5 2021-06-15 10:30:08 -07:00
Steven Powell 599e7c49e9 create automated time-to-k8s benchmarks on release 2021-06-15 10:17:46 -07:00
Andriy Dzikh 231fbee7b5 Fix collect_data_manual not being formatted correctly. 2021-06-15 09:55:32 -07:00
Medya Ghazizadeh 6a9076391d
Merge pull request #11602 from andriyDev/Flakes
Create a system for generating public flake rate reporting.
2021-06-15 12:51:29 -04:00
Sharif Elgamal 76d74191d8
Merge pull request #11623 from sharifelgamal/1.21.0
Bump Makefile for 1.21.0 release
2021-06-11 08:46:19 -07:00
Andriy Dzikh 1c1fdbff42 Make compute_flake_rate also compute average test duration. 2021-06-10 14:00:47 -07:00
Andriy Dzikh 728229c719 Add more environments to the allowed environments for commenting. 2021-06-10 13:36:23 -07:00
Andriy Dzikh dc6cb0b671 Rename collect_data.sh to collect_data_manual.sh and make header comment more clear. 2021-06-10 13:30:35 -07:00
Andriy Dzikh 884216db9e Make report_flakes.sh abort if there are no failed tests. 2021-06-10 13:27:00 -07:00
Andriy Dzikh 7e785c1c1e Make collect_data.sh optimzie and upload to GCS automatically. 2021-06-10 13:19:05 -07:00
Andriy Dzikh a98db3511e Add description and example usage to all shell scripts. 2021-06-10 13:16:16 -07:00
Andriy Dzikh 2b3f7cedd7 Remove bootstrap from flake_chart.html. 2021-06-10 13:02:56 -07:00
Sharif Elgamal 79e1b4e99d Bump Makefile for 1.21.0 release 2021-06-10 11:34:06 -07:00
Andriy Dzikh ecaee4d932 Add better comments for optimize_data and process_data. 2021-06-10 11:16:44 -07:00
Andriy Dzikh 79f8de1bcb Add comment for testEntry. 2021-06-10 11:11:34 -07:00
Andriy Dzikh e9e7b85e02 Make types and functions private. 2021-06-10 11:08:44 -07:00
Steven Powell cc89907cca add -Force to folder rm 2021-06-10 10:40:49 -07:00
Andriy Dzikh e089973f65 Create SplitEntryMap type to simplify some definitions. 2021-06-09 15:21:43 -07:00
Steven Powell 3b27578610 delete `minikube-integration` folder in case last test failed to delete it 2021-06-09 15:11:03 -07:00
Andriy Dzikh fb8e4d982b Clean up compute_flake_rate.go. 2021-06-08 13:06:28 -07:00
Andriy Dzikh fcbae7eaa1 Make sure gh is present when running report_flakes.sh. 2021-06-08 11:54:08 -07:00
Andriy Dzikh 3aa922813c Fix wrong number of parameters for report_flakes.sh. 2021-06-08 11:50:14 -07:00
Andriy Dzikh 716f690189 Change copyright to 2021. 2021-06-07 16:39:06 -07:00
Andriy Dzikh 139d7e3771 Fix lints in compute_flake_rate.go and compute_flake_rate_test.go. 2021-06-07 16:36:01 -07:00
Andriy Dzikh 8f953781a2 Create report_flakes script to comment on PRs about flake rates of failed tests. 2021-06-07 14:44:49 -07:00
Andriy Dzikh 7c46154600 Rename jenkins_upload_tests.sh to upload_tests.sh.
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
2021-06-07 14:12:31 -07:00
Andriy Dzikh 501b238841 Use "set -eu -o pipefail" for all scripts.
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
2021-06-07 14:09:32 -07:00
Andriy Dzikh 9e7f1ebbf0 Make computing flake rates print out percentages (with fixed 2 decimal precision) rather than floats. 2021-06-07 13:49:40 -07:00
Andriy Dzikh a80f3bc5ae Add license to upload_tests script. 2021-06-07 13:49:05 -07:00
Steven Powell b39f171268 ensure Windows integration tests are ephemeral 2021-06-04 14:08:37 -07:00
Andriy Dzikh cec82877d8 Format flake rates into CSV containing environment, test, and flake rate. 2021-06-03 14:25:04 -07:00
Andriy Dzikh d245cfcdf7 Move all flake rate files to Jenkins to allow auto-upload. 2021-06-03 14:12:03 -07:00
Andriy Dzikh 40fdbe61ae Allow Jenkins to append to the flake rate data. 2021-06-03 14:01:06 -07:00
Andriy Dzikh d7d3593a89 Rewrite process_data.sh to no longer depend on git log.
This now means we depend on the date being contained within the details.
2021-06-03 13:38:44 -07:00
Medya Gh 74fe0e9f62 bump gopogh 2021-06-02 16:30:50 -07:00
Andriy Dzikh 65be305aab Add test for ComputeFlakeRates. 2021-06-02 16:17:39 -07:00
Andriy Dzikh df6f7a8485 Add test for FilterRecentEntries. 2021-06-02 15:48:12 -07:00
Andriy Dzikh 4e9718a28b Add test for SplitData. 2021-06-02 14:15:25 -07:00
Andriy Dzikh 401bcbfe0a Move comparison code to its own function. 2021-06-02 14:12:43 -07:00
Andriy Dzikh 9d4153f0ab Create test for ReadData. 2021-06-02 14:00:01 -07:00
Andriy Dzikh 60929009d6 Create FilterRecentEntries to only include the last N run dates. 2021-06-02 11:01:33 -07:00
Andriy Dzikh e6a553f679 Compute flake rate of all entries split by environment and test. 2021-06-02 11:00:40 -07:00