Commit Graph

154 Commits (master)

Author SHA1 Message Date
Sharif Elgamal 9446725acd fix bash syntax for filtering 2021-09-09 10:16:13 -07:00
Sharif Elgamal 1997995132 syntax 2021-09-08 17:19:06 -07:00
Sharif Elgamal d3d4f74d8a filter out arm64 and macOS from flake reports 2021-09-08 17:14:01 -07:00
Andriy Dzikh 7e3d874265 Display date in a better format, since old format reported time of 0:00 am 2021-08-17 09:37:52 -07:00
Andriy Dzikh aa90cfb57f Replace Math.min with destructuring with custom array min. 2021-08-16 16:19:47 -07:00
Andriy Dzikh aae6390004 Add link directly to test log for gopogh link. 2021-08-12 10:05:43 -07:00
Andriy Dzikh 146f1dd3eb Add link to flake charts in auto-created issues 2021-08-10 13:50:34 -07:00
Sharif Elgamal 59a2929394
Merge pull request #12176 from andriyDev/ChangeDateRange
Change date range to be relative to the current day
2021-08-10 13:09:41 -07:00
Andriy Dzikh 4efd9514c5 Add priority/backlog label to all newly created issues. 2021-08-10 11:22:51 -07:00
Andriy Dzikh 6c36bb49ab Ensure gh is installed for compute_flake_rate. 2021-08-10 10:19:17 -07:00
Andriy Dzikh b252738824 Use gh and flake rates csv to manage issues for flake rates. 2021-08-09 17:17:04 -07:00
Andriy Dzikh 7bdb76deb6 For missing flake rate, do not link to the charts. 2021-08-09 14:41:45 -07:00
Andriy Dzikh 7e14f87786 Add reporting for tests with no flake rates computed. 2021-08-09 14:09:09 -07:00
Andriy Dzikh 790d2f1aab Refactor report_flakes.sh to make it easier to read. 2021-08-09 14:04:20 -07:00
Andriy Dzikh 9ea203bb2a Make date range be relative to the current date rather than based on when tests ran. 2021-08-09 10:22:30 -07:00
Andriy Dzikh dc11031e70 Create script to handle flake rate computation Jenkins job. 2021-08-06 09:35:08 -07:00
Sharif Elgamal 923455d7ca
Merge pull request #12111 from andriyDev/SimplifyLineCode
Replace yield iterator with simple await array
2021-08-04 10:08:58 -07:00
Medya Ghazizadeh 8d20e4f49e
Merge pull request #12112 from andriyDev/DisableCaching
Manage caching of HTML/JS/data.csv for public flake rate system
2021-08-03 20:46:40 -07:00
Andriy Dzikh fbd96a4bad Add cache control to ensure data.csv is checked at least after an hour of use. 2021-08-03 15:35:10 -07:00
Andriy Dzikh 1515f668dd Prevent caching of flake_chart.js. 2021-08-03 15:35:10 -07:00
Andriy Dzikh a27500e1b5 Disable caching on HTML. 2021-08-03 15:35:10 -07:00
Andriy Dzikh 4e0478eb97 Add progress bar for parsing data. 2021-08-03 14:51:52 -07:00
Andriy Dzikh 37d7ff3eff Turn bodyByLinesIterator into getBodyLinesWithProgress.
Yielding is slow! Improves processing time from 8s to 3s.
2021-08-03 14:22:31 -07:00
Andriy Dzikh 01343b001b Simplify bodyByLinesIterator to only use splitting instead of regex. 2021-08-03 13:55:33 -07:00
Andriy Dzikh c2a4e03ad0 Add message at bottom of page saying when the data was collected. 2021-08-03 10:49:24 -07:00
Medya Ghazizadeh d69a98c45c
Merge pull request #12065 from andriyDev/UseJobId
Use job id for logs instead of short commit hash
2021-07-28 13:30:50 -07:00
Andriy Dzikh 6b21eff101 Update flake charts to use new link setup. 2021-07-27 13:28:33 -07:00
Andriy Dzikh 2951ab9a33 Replace all links in hack/jenkins using short commit with root job id. 2021-07-27 11:35:43 -07:00
Andriy Dzikh 780b11bdae Parse report data correctly in report-flakes. 2021-07-27 10:33:52 -07:00
Andriy Dzikh 14e6012fd0 Fix compute flake rate not reading data correctly. 2021-07-27 09:28:13 -07:00
Andriy Dzikh 617d4e3bdf Use root job id to collect test count and total duration for all jobs. 2021-07-26 15:55:26 -07:00
Andriy Dzikh 6e100f1402 Parse root job and related fields in JS. 2021-07-26 15:42:58 -07:00
Andriy Dzikh 5e528689e6 Remove duration chart. 2021-07-26 11:54:41 -07:00
Andriy Dzikh ec4848686d Add fields to csv data for root job ids and related variables. 2021-07-26 10:30:13 -07:00
Andriy Dzikh c47d07612b Add safety check to data processing to prevent inheritance from previous entries. 2021-07-26 10:30:10 -07:00
Andriy Dzikh 6c558a9586 Refactor process script to be more readable. 2021-07-26 10:18:01 -07:00
Andriy Dzikh 16faa3c377 Add by-week flake rate charts. 2021-07-23 13:45:26 -07:00
Andriy Dzikh a6e5755b24 Add click to sort columns to flake rate table on env page. 2021-07-23 09:16:47 -07:00
Andriy Dzikh 58324bec35 Add links to gopogh logs for each test. 2021-07-22 15:34:25 -07:00
Andriy Dzikh 6ada9a0ebc Refactor report_flakes sed to make it more readable. 2021-07-22 15:33:33 -07:00
Andriy Dzikh 8afbf67c48 Remove extra bracket in flake rate comment. 2021-07-22 14:33:04 -07:00
Andriy Dzikh 6176111a5c Add link to environment pages to flake rate comments. 2021-07-19 13:40:41 -07:00
Andriy Dzikh 7ca1ce55d0 No longer use non-existent ENVIRONMENT variable. 2021-07-17 14:54:42 -07:00
Andriy Dzikh 3d29731932 ls gopogh reports first to ensure they are valid, then cat the valid ones together. 2021-07-17 10:57:18 -07:00
Andriy Dzikh 0fe08d715d Install jq on machines when running sync_tests.sh. 2021-07-15 14:26:02 -07:00
Andriy Dzikh 031f3331e7 Fix flake report script badly formatted. 2021-07-15 10:54:43 -07:00
Andriy Dzikh c64ba2c080 Fix report scripts to print out only started environments, and use quotes around script names. 2021-07-12 10:10:54 -07:00
Andriy Dzikh ae294d2067 Make sync_tests.sh remove any _integration suffix. 2021-07-07 09:21:00 -07:00
Medya Ghazizadeh a1300b1d32
Merge pull request #11874 from andriyDev/MoreCharts
More charts
2021-07-02 09:45:19 -04:00
Sharif Elgamal 7c45056827
Merge pull request #11851 from andriyDev/fix-flake-sync
Replace integration test "hooks" with standalone scripts
2021-07-01 16:17:54 -07:00
Andriy Dzikh 5d0eba44ec Add test count/fail count chart to environment page. 2021-07-01 16:02:22 -07:00
Andriy Dzikh d1b6549fbb Add duration graph to environment flake rates. 2021-07-01 14:29:19 -07:00
Andriy Dzikh 3904c6deab Ignore upload fail. 2021-07-01 13:32:20 -07:00
Andriy Dzikh 5dfb6726bd Make upload_tests use a remote GCS file. 2021-07-01 13:32:20 -07:00
Andriy Dzikh b5caf568ac Add growth column to flake list. 2021-07-01 12:01:09 -07:00
Andriy Dzikh d8ffe3f9fa Add rank column to flake rate list. 2021-07-01 11:47:40 -07:00
Andriy Dzikh a203d5f644 Replace integration test "hooks" with register_tests to fill started_environments and sync_tests to fill finished environments. 2021-07-01 11:09:34 -07:00
Medya Ghazizadeh 323733c532
Merge pull request #11816 from andriyDev/FlakeRateSync
Report flakes only after synchronizing all integration tests
2021-06-30 16:38:08 -04:00
Andriy Dzikh 7ea94ed00a Add license and comment describing what the script does. 2021-06-29 14:51:31 -07:00
Andriy Dzikh 858aab3f55 Create sync_tests.sh to be triggered by each integration test on completion. 2021-06-29 11:44:36 -07:00
Andriy Dzikh 4f114dafb9 Add comment to report_flakes.sh to see environment flake charts. 2021-06-28 09:19:43 -07:00
Medya Ghazizadeh 4d078ae82f
Merge pull request #11766 from andriyDev/EnvPage
Create page with all tests for an environment in flake rate charts
2021-06-25 19:27:00 -04:00
Andriy Dzikh e9932aa7db Improve error handling to actually render in the UI. 2021-06-25 11:13:46 -07:00
Andriy Dzikh f57d7ae723 Create loading bar while downloading flake chart data. 2021-06-25 11:05:49 -07:00
Andriy Dzikh 637e8326fd Implement proper body-by-lines iterator. 2021-06-25 10:47:06 -07:00
Andriy Dzikh eeaf03e4a3 Add name of test to each point in environment flake page. 2021-06-25 09:43:47 -07:00
Andriy Dzikh b1ec38f808 Add links to charts for each individual test on environment page. 2021-06-25 09:39:13 -07:00
Andriy Dzikh c067ea6cda Create table to show all flake rates for a specific environment. 2021-06-25 09:39:13 -07:00
Andriy Dzikh e22ddb9238 Compute flakeiness based on last 15 days and only chart top 10 flakiest tests. 2021-06-25 09:39:13 -07:00
Andriy Dzikh 9d41adbf06 Create page for viewing all tests for an environment. 2021-06-25 09:39:11 -07:00
Andriy Dzikh fc6c4eb04e Move existing formatting/charting code into its own function. 2021-06-25 09:29:54 -07:00
Andriy Dzikh f404d5976f Refactor flake chart data processing to simplify into two steps: aggregation and formatting. 2021-06-25 09:26:57 -07:00
Andriy Dzikh a0c5634dfd Make nicer fonts for test tooltips in flake charts. 2021-06-24 11:57:07 -07:00
Andriy Dzikh 1c7d6b719c Add links to hashes in flake charts. 2021-06-24 11:51:00 -07:00
Andriy Dzikh 0ff73cf645 Group commit hashes into one entry rather than one entry per run. 2021-06-24 11:42:50 -07:00
Medya Ghazizadeh 5501afa9ef
Merge pull request #11683 from andriyDev/FixNoFlakesComment
Fix flake rates being commented about when no failed tests are present.
2021-06-17 17:58:44 -04:00
Medya Ghazizadeh 7d9bcf8626
Merge pull request #11684 from andriyDev/ChangeFlakeColors
Update flake chart colors
2021-06-17 13:00:46 -04:00
Andriy Dzikh 300230bd5c Update flake chart colors. 2021-06-17 09:41:40 -07:00
Andriy Dzikh 5b8b5ce102 Fix flake rates being commented about when no failed tests are present. 2021-06-17 09:28:27 -07:00
Andriy Dzikh 9f601ea393 Fix commenting to a PR instead of an issue. 2021-06-16 18:03:52 -07:00
Andriy Dzikh c037e5f62f Stop using sudo for check_install_gh. 2021-06-16 15:29:50 -07:00
Andriy Dzikh 231fbee7b5 Fix collect_data_manual not being formatted correctly. 2021-06-15 09:55:32 -07:00
Andriy Dzikh 1c1fdbff42 Make compute_flake_rate also compute average test duration. 2021-06-10 14:00:47 -07:00
Andriy Dzikh dc6cb0b671 Rename collect_data.sh to collect_data_manual.sh and make header comment more clear. 2021-06-10 13:30:35 -07:00
Andriy Dzikh 884216db9e Make report_flakes.sh abort if there are no failed tests. 2021-06-10 13:27:00 -07:00
Andriy Dzikh 7e785c1c1e Make collect_data.sh optimzie and upload to GCS automatically. 2021-06-10 13:19:05 -07:00
Andriy Dzikh a98db3511e Add description and example usage to all shell scripts. 2021-06-10 13:16:16 -07:00
Andriy Dzikh 2b3f7cedd7 Remove bootstrap from flake_chart.html. 2021-06-10 13:02:56 -07:00
Andriy Dzikh ecaee4d932 Add better comments for optimize_data and process_data. 2021-06-10 11:16:44 -07:00
Andriy Dzikh 79f8de1bcb Add comment for testEntry. 2021-06-10 11:11:34 -07:00
Andriy Dzikh e9e7b85e02 Make types and functions private. 2021-06-10 11:08:44 -07:00
Andriy Dzikh e089973f65 Create SplitEntryMap type to simplify some definitions. 2021-06-09 15:21:43 -07:00
Andriy Dzikh fb8e4d982b Clean up compute_flake_rate.go. 2021-06-08 13:06:28 -07:00
Andriy Dzikh fcbae7eaa1 Make sure gh is present when running report_flakes.sh. 2021-06-08 11:54:08 -07:00
Andriy Dzikh 3aa922813c Fix wrong number of parameters for report_flakes.sh. 2021-06-08 11:50:14 -07:00
Andriy Dzikh 716f690189 Change copyright to 2021. 2021-06-07 16:39:06 -07:00
Andriy Dzikh 139d7e3771 Fix lints in compute_flake_rate.go and compute_flake_rate_test.go. 2021-06-07 16:36:01 -07:00
Andriy Dzikh 8f953781a2 Create report_flakes script to comment on PRs about flake rates of failed tests. 2021-06-07 14:44:49 -07:00
Andriy Dzikh 7c46154600 Rename jenkins_upload_tests.sh to upload_tests.sh.
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
2021-06-07 14:12:31 -07:00
Andriy Dzikh 501b238841 Use "set -eu -o pipefail" for all scripts.
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
2021-06-07 14:09:32 -07:00