Andriy Dzikh
|
7e14f87786
|
Add reporting for tests with no flake rates computed.
|
2021-08-09 14:09:09 -07:00 |
|
Andriy Dzikh
|
790d2f1aab
|
Refactor report_flakes.sh to make it easier to read.
|
2021-08-09 14:04:20 -07:00 |
|
Andriy Dzikh
|
9ea203bb2a
|
Make date range be relative to the current date rather than based on when tests ran.
|
2021-08-09 10:22:30 -07:00 |
minikube-bot
|
f3a069b729
|
bump golang versions
|
2021-08-09 09:02:04 +00:00 |
|
Andriy Dzikh
|
dc11031e70
|
Create script to handle flake rate computation Jenkins job.
|
2021-08-06 09:35:08 -07:00 |
Sharif Elgamal
|
923455d7ca
|
Merge pull request #12111 from andriyDev/SimplifyLineCode
Replace yield iterator with simple await array
|
2021-08-04 10:08:58 -07:00 |
Medya Ghazizadeh
|
8d20e4f49e
|
Merge pull request #12112 from andriyDev/DisableCaching
Manage caching of HTML/JS/data.csv for public flake rate system
|
2021-08-03 20:46:40 -07:00 |
|
Andriy Dzikh
|
fbd96a4bad
|
Add cache control to ensure data.csv is checked at least after an hour of use.
|
2021-08-03 15:35:10 -07:00 |
|
Andriy Dzikh
|
1515f668dd
|
Prevent caching of flake_chart.js.
|
2021-08-03 15:35:10 -07:00 |
|
Andriy Dzikh
|
a27500e1b5
|
Disable caching on HTML.
|
2021-08-03 15:35:10 -07:00 |
|
Andriy Dzikh
|
4e0478eb97
|
Add progress bar for parsing data.
|
2021-08-03 14:51:52 -07:00 |
|
Andriy Dzikh
|
37d7ff3eff
|
Turn bodyByLinesIterator into getBodyLinesWithProgress.
Yielding is slow! Improves processing time from 8s to 3s.
|
2021-08-03 14:22:31 -07:00 |
|
Andriy Dzikh
|
01343b001b
|
Simplify bodyByLinesIterator to only use splitting instead of regex.
|
2021-08-03 13:55:33 -07:00 |
|
Andriy Dzikh
|
c2a4e03ad0
|
Add message at bottom of page saying when the data was collected.
|
2021-08-03 10:49:24 -07:00 |
|
minikube-bot
|
390c72ec61
|
bump golang versions
|
2021-07-28 23:11:44 +00:00 |
|
Medya Ghazizadeh
|
93b084a7fb
|
Merge pull request #12068 from andriyDev/VariableNameScoping
Add brackets around variable name to prevent scoping problems
|
2021-07-28 13:31:16 -07:00 |
|
Medya Ghazizadeh
|
d69a98c45c
|
Merge pull request #12065 from andriyDev/UseJobId
Use job id for logs instead of short commit hash
|
2021-07-28 13:30:50 -07:00 |
|
Andriy Dzikh
|
fd3354fad2
|
Add brackets around variable name to prevent scoping problems.
|
2021-07-28 13:22:32 -07:00 |
|
Andriy Dzikh
|
6b21eff101
|
Update flake charts to use new link setup.
|
2021-07-27 13:28:33 -07:00 |
|
Andriy Dzikh
|
2951ab9a33
|
Replace all links in hack/jenkins using short commit with root job id.
|
2021-07-27 11:35:43 -07:00 |
|
Andriy Dzikh
|
780b11bdae
|
Parse report data correctly in report-flakes.
|
2021-07-27 10:33:52 -07:00 |
|
Andriy Dzikh
|
14e6012fd0
|
Fix compute flake rate not reading data correctly.
|
2021-07-27 09:28:13 -07:00 |
|
Andriy Dzikh
|
617d4e3bdf
|
Use root job id to collect test count and total duration for all jobs.
|
2021-07-26 15:55:26 -07:00 |
|
Andriy Dzikh
|
6e100f1402
|
Parse root job and related fields in JS.
|
2021-07-26 15:42:58 -07:00 |
|
Andriy Dzikh
|
5e528689e6
|
Remove duration chart.
|
2021-07-26 11:54:41 -07:00 |
|
Andriy Dzikh
|
ec4848686d
|
Add fields to csv data for root job ids and related variables.
|
2021-07-26 10:30:13 -07:00 |
|
Andriy Dzikh
|
c47d07612b
|
Add safety check to data processing to prevent inheritance from previous entries.
|
2021-07-26 10:30:10 -07:00 |
|
Andriy Dzikh
|
047be99688
|
Add ROOT_JOB_ID to gopogh details.
|
2021-07-26 10:23:27 -07:00 |
|
Andriy Dzikh
|
5c16d26379
|
Add current date to common.ps1 (missing for Windows).
|
2021-07-26 10:23:27 -07:00 |
|
Andriy Dzikh
|
6c558a9586
|
Refactor process script to be more readable.
|
2021-07-26 10:18:01 -07:00 |
|
Andriy Dzikh
|
a0facafa5e
|
Bump gopogh version from v0.8.0 to v0.9.0.
|
2021-07-23 15:45:14 -07:00 |
|
Andriy Dzikh
|
16faa3c377
|
Add by-week flake rate charts.
|
2021-07-23 13:45:26 -07:00 |
|
Andriy Dzikh
|
a6e5755b24
|
Add click to sort columns to flake rate table on env page.
|
2021-07-23 09:16:47 -07:00 |
|
Andriy Dzikh
|
58324bec35
|
Add links to gopogh logs for each test.
|
2021-07-22 15:34:25 -07:00 |
|
Andriy Dzikh
|
6ada9a0ebc
|
Refactor report_flakes sed to make it more readable.
|
2021-07-22 15:33:33 -07:00 |
|
Andriy Dzikh
|
8afbf67c48
|
Remove extra bracket in flake rate comment.
|
2021-07-22 14:33:04 -07:00 |
Steven Powell
|
92b7ba0c1e
|
Merge pull request #11420 from ntkme/fully-qualified-image-name
Use fully qualified image name for kicbase image from docker hub
|
2021-07-21 18:47:42 +00:00 |
|
Medya Ghazizadeh
|
0918511a45
|
Merge pull request #11986 from andriyDev/fix-flake
Fix flake report script not commenting
|
2021-07-19 18:31:48 -07:00 |
|
Andriy Dzikh
|
6176111a5c
|
Add link to environment pages to flake rate comments.
|
2021-07-19 13:40:41 -07:00 |
|
Andriy Dzikh
|
7ca1ce55d0
|
No longer use non-existent ENVIRONMENT variable.
|
2021-07-17 14:54:42 -07:00 |
|
Andriy Dzikh
|
3d29731932
|
ls gopogh reports first to ensure they are valid, then cat the valid ones together.
|
2021-07-17 10:57:18 -07:00 |
|
Andriy Dzikh
|
f26764f17a
|
Move gotestsum installation to common.ps1
|
2021-07-15 14:42:49 -07:00 |
|
Andriy Dzikh
|
0fe08d715d
|
Install jq on machines when running sync_tests.sh.
|
2021-07-15 14:26:02 -07:00 |
|
Andriy Dzikh
|
031f3331e7
|
Fix flake report script badly formatted.
|
2021-07-15 10:54:43 -07:00 |
なつき
|
4040311f1e
|
Use fully qualified image name for docker hub fallback image
|
2021-07-13 16:09:55 -07:00 |
|
Andriy Dzikh
|
636329eb13
|
Install gotestsum with sudo.
|
2021-07-13 14:17:32 -07:00 |
|
Andriy Dzikh
|
25e561a4f7
|
Create proper installer script for gotestsum.
|
2021-07-13 14:17:32 -07:00 |
|
Andriy Dzikh
|
b9d6528f26
|
Use gotestsum for testing output and json output.
|
2021-07-13 14:17:30 -07:00 |
|
Sharif Elgamal
|
ad74478c78
|
Merge pull request #11950 from andriyDev/WindowsCommon
Create common.ps1 to simplify Windows integration tests
|
2021-07-13 13:23:11 -07:00 |
ilya-zuyev
|
e27dba4f40
|
Merge pull request #11941 from ilya-zuyev/ilyaz/fix_arm_tests
minor fixes in common.sh
|
2021-07-13 13:19:26 -07:00 |
Ilya Zuyev
|
92604a3c00
|
simplify check_install_golang.sh invocation
|
2021-07-13 11:47:20 -07:00 |
|
Steven Powell
|
aa92f4106c
|
Merge pull request #11921 from andriyDev/fix-set-pending-2
Use THE_COMMIT env var instead of ghprbActualCommit
|
2021-07-12 23:58:06 +00:00 |
|
Andriy Dzikh
|
0589a42fdf
|
Use -eq instead of == because Powershell bad.
|
2021-07-12 14:10:50 -07:00 |
|
Andriy Dzikh
|
c64ba2c080
|
Fix report scripts to print out only started environments, and use quotes around script names.
|
2021-07-12 10:10:54 -07:00 |
|
Andriy Dzikh
|
b6e55e6c97
|
Create common.ps1 to simplify Windows integration tests.
|
2021-07-09 13:27:02 -07:00 |
|
Ilya Zuyev
|
579bebda1a
|
fix script
|
2021-07-08 15:00:13 -07:00 |
|
Ilya Zuyev
|
baa86c389a
|
fix scripts
|
2021-07-08 13:43:10 -07:00 |
Steven Powell
|
bc7995f81b
|
update contact to Medya
|
2021-07-07 15:14:53 -07:00 |
|
Andriy Dzikh
|
3afe680c92
|
Use THE_COMMIT env var instead of ghprbActualCommit.
|
2021-07-07 13:15:33 -07:00 |
|
Andriy Dzikh
|
50e07ae7ec
|
Move environment start saving up in minikube_set_pending.
|
2021-07-07 11:19:35 -07:00 |
|
Andriy Dzikh
|
ae294d2067
|
Make sync_tests.sh remove any _integration suffix.
|
2021-07-07 09:21:00 -07:00 |
|
Medya Ghazizadeh
|
429b00d4f0
|
Merge pull request #11857 from ilya-zuyev/ilyaz/upload_arm64_to_gcs
fix kvm2-arm64 scripts
|
2021-07-02 10:10:27 -04:00 |
|
Medya Ghazizadeh
|
a1300b1d32
|
Merge pull request #11874 from andriyDev/MoreCharts
More charts
|
2021-07-02 09:45:19 -04:00 |
|
Medya Ghazizadeh
|
5ecd53b1ea
|
Merge pull request #11794 from ilya-zuyev/ilyaz/test_report_links
Show GCS report links in integration test logs
|
2021-07-02 09:37:14 -04:00 |
|
Sharif Elgamal
|
7c45056827
|
Merge pull request #11851 from andriyDev/fix-flake-sync
Replace integration test "hooks" with standalone scripts
|
2021-07-01 16:17:54 -07:00 |
|
Andriy Dzikh
|
5d0eba44ec
|
Add test count/fail count chart to environment page.
|
2021-07-01 16:02:22 -07:00 |
|
Andriy Dzikh
|
a442d79877
|
Remove STARTED_ENVIRONMENTS from common.sh.
|
2021-07-01 15:53:52 -07:00 |
|
Andriy Dzikh
|
d1b6549fbb
|
Add duration graph to environment flake rates.
|
2021-07-01 14:29:19 -07:00 |
|
Ilya Zuyev
|
6e46d895dc
|
Merge branch 'master' into ilyaz/test_report_links
|
2021-07-01 13:51:14 -07:00 |
|
Ilya Zuyev
|
5ccd38c0f7
|
fix output formatting
|
2021-07-01 13:47:40 -07:00 |
|
Andriy Dzikh
|
3904c6deab
|
Ignore upload fail.
|
2021-07-01 13:32:20 -07:00 |
|
Andriy Dzikh
|
5dfb6726bd
|
Make upload_tests use a remote GCS file.
|
2021-07-01 13:32:20 -07:00 |
|
Ilya Zuyev
|
3b5675d9e0
|
fix
|
2021-07-01 13:31:44 -07:00 |
|
Ilya Zuyev
|
2beaea9fc1
|
fix
|
2021-07-01 12:27:06 -07:00 |
|
Ilya Zuyev
|
ea6d16db41
|
for PR builds: build kvm2-arm64 deb
|
2021-07-01 12:14:03 -07:00 |
|
Andriy Dzikh
|
b5caf568ac
|
Add growth column to flake list.
|
2021-07-01 12:01:09 -07:00 |
|
Andriy Dzikh
|
d8ffe3f9fa
|
Add rank column to flake rate list.
|
2021-07-01 11:47:40 -07:00 |
|
Andriy Dzikh
|
a203d5f644
|
Replace integration test "hooks" with register_tests to fill started_environments and sync_tests to fill finished environments.
|
2021-07-01 11:09:34 -07:00 |
|
Steven Powell
|
a9157c2433
|
improve Windows Docker clean slate
|
2021-06-30 16:42:09 -07:00 |
|
Medya Ghazizadeh
|
c2f18d9d4b
|
Merge pull request #11841 from sharifelgamal/ugly-err
remove ugly error message from kicbase and ISO autobuild
|
2021-06-30 17:26:37 -04:00 |
|
Sharif Elgamal
|
d8f8e3faf7
|
Merge pull request #11803 from sharifelgamal/mac-test
try less parallelization for macOS tests
|
2021-06-30 14:17:48 -07:00 |
|
Sharif Elgamal
|
06c1da3076
|
make URLs easier to copy
|
2021-06-30 14:01:14 -07:00 |
|
Medya Ghazizadeh
|
a50406e269
|
Merge pull request #11767 from ilya-zuyev/ilyaz/arm64_kvm_release
Update release scripts to build arm64 version of kvm2 driver
|
2021-06-30 16:49:09 -04:00 |
|
Sharif Elgamal
|
1e7f8cbaa7
|
remove ugly error message from kicbase and ISO autobuild
|
2021-06-30 13:40:18 -07:00 |
|
Medya Ghazizadeh
|
323733c532
|
Merge pull request #11816 from andriyDev/FlakeRateSync
Report flakes only after synchronizing all integration tests
|
2021-06-30 16:38:08 -04:00 |
|
Andriy Dzikh
|
7ea94ed00a
|
Add license and comment describing what the script does.
|
2021-06-29 14:51:31 -07:00 |
|
Andriy Dzikh
|
e3883d0b56
|
Fix writing wrong files, and added better comments.
|
2021-06-29 14:47:13 -07:00 |
|
Andriy Dzikh
|
f2c64cdb2b
|
Add support for syncing Docker_Windows.
|
2021-06-29 13:32:54 -07:00 |
|
Sharif Elgamal
|
73e42a9a8c
|
change parallelization in code
|
2021-06-29 11:46:38 -07:00 |
|
Andriy Dzikh
|
858aab3f55
|
Create sync_tests.sh to be triggered by each integration test on completion.
|
2021-06-29 11:44:36 -07:00 |
|
Sharif Elgamal
|
065929ffd0
|
try less parallelization for macOS tests
|
2021-06-29 09:22:42 -07:00 |
|
Ilya Zuyev
|
bed20c522b
|
In integration test logs: show GCS https links to reports
|
2021-06-28 14:34:05 -07:00 |
|
Andriy Dzikh
|
4f114dafb9
|
Add comment to report_flakes.sh to see environment flake charts.
|
2021-06-28 09:19:43 -07:00 |
|
Medya Ghazizadeh
|
4d078ae82f
|
Merge pull request #11766 from andriyDev/EnvPage
Create page with all tests for an environment in flake rate charts
|
2021-06-25 19:27:00 -04:00 |
|
Andriy Dzikh
|
e9932aa7db
|
Improve error handling to actually render in the UI.
|
2021-06-25 11:13:46 -07:00 |
|
Andriy Dzikh
|
f57d7ae723
|
Create loading bar while downloading flake chart data.
|
2021-06-25 11:05:49 -07:00 |
|
Andriy Dzikh
|
637e8326fd
|
Implement proper body-by-lines iterator.
|
2021-06-25 10:47:06 -07:00 |
|
Ilya Zuyev
|
cb31ce2e7d
|
remove kvm2-arm64 rpm
|
2021-06-25 10:08:40 -07:00 |
|
Andriy Dzikh
|
eeaf03e4a3
|
Add name of test to each point in environment flake page.
|
2021-06-25 09:43:47 -07:00 |
|
Andriy Dzikh
|
b1ec38f808
|
Add links to charts for each individual test on environment page.
|
2021-06-25 09:39:13 -07:00 |
|
Andriy Dzikh
|
c067ea6cda
|
Create table to show all flake rates for a specific environment.
|
2021-06-25 09:39:13 -07:00 |
|
Andriy Dzikh
|
e22ddb9238
|
Compute flakeiness based on last 15 days and only chart top 10 flakiest tests.
|
2021-06-25 09:39:13 -07:00 |
|
Andriy Dzikh
|
9d41adbf06
|
Create page for viewing all tests for an environment.
|
2021-06-25 09:39:11 -07:00 |
|
Andriy Dzikh
|
fc6c4eb04e
|
Move existing formatting/charting code into its own function.
|
2021-06-25 09:29:54 -07:00 |
|
Andriy Dzikh
|
f404d5976f
|
Refactor flake chart data processing to simplify into two steps: aggregation and formatting.
|
2021-06-25 09:26:57 -07:00 |
|
Ilya Zuyev
|
0033bf7ed3
|
make targets for deb and rpm
|
2021-06-24 20:02:21 -07:00 |
|
Andriy Dzikh
|
a0c5634dfd
|
Make nicer fonts for test tooltips in flake charts.
|
2021-06-24 11:57:07 -07:00 |
|
Andriy Dzikh
|
1c7d6b719c
|
Add links to hashes in flake charts.
|
2021-06-24 11:51:00 -07:00 |
|
Andriy Dzikh
|
0ff73cf645
|
Group commit hashes into one entry rather than one entry per run.
|
2021-06-24 11:42:50 -07:00 |
|
Andriy Dzikh
|
fbf61e3e33
|
Fix running a non-existent command in upload_integration_report.
|
2021-06-22 14:55:49 -07:00 |
|
Medya Ghazizadeh
|
5501afa9ef
|
Merge pull request #11683 from andriyDev/FixNoFlakesComment
Fix flake rates being commented about when no failed tests are present.
|
2021-06-17 17:58:44 -04:00 |
|
Medya Ghazizadeh
|
7d9bcf8626
|
Merge pull request #11684 from andriyDev/ChangeFlakeColors
Update flake chart colors
|
2021-06-17 13:00:46 -04:00 |
|
Andriy Dzikh
|
300230bd5c
|
Update flake chart colors.
|
2021-06-17 09:41:40 -07:00 |
|
Andriy Dzikh
|
5b8b5ce102
|
Fix flake rates being commented about when no failed tests are present.
|
2021-06-17 09:28:27 -07:00 |
|
Andriy Dzikh
|
9f601ea393
|
Fix commenting to a PR instead of an issue.
|
2021-06-16 18:03:52 -07:00 |
|
Andriy Dzikh
|
c037e5f62f
|
Stop using sudo for check_install_gh.
|
2021-06-16 15:29:50 -07:00 |
|
Andriy Dzikh
|
231fbee7b5
|
Fix collect_data_manual not being formatted correctly.
|
2021-06-15 09:55:32 -07:00 |
|
Medya Ghazizadeh
|
6a9076391d
|
Merge pull request #11602 from andriyDev/Flakes
Create a system for generating public flake rate reporting.
|
2021-06-15 12:51:29 -04:00 |
|
Andriy Dzikh
|
1c1fdbff42
|
Make compute_flake_rate also compute average test duration.
|
2021-06-10 14:00:47 -07:00 |
|
Andriy Dzikh
|
728229c719
|
Add more environments to the allowed environments for commenting.
|
2021-06-10 13:36:23 -07:00 |
|
Andriy Dzikh
|
dc6cb0b671
|
Rename collect_data.sh to collect_data_manual.sh and make header comment more clear.
|
2021-06-10 13:30:35 -07:00 |
|
Andriy Dzikh
|
884216db9e
|
Make report_flakes.sh abort if there are no failed tests.
|
2021-06-10 13:27:00 -07:00 |
|
Andriy Dzikh
|
7e785c1c1e
|
Make collect_data.sh optimzie and upload to GCS automatically.
|
2021-06-10 13:19:05 -07:00 |
|
Andriy Dzikh
|
a98db3511e
|
Add description and example usage to all shell scripts.
|
2021-06-10 13:16:16 -07:00 |
|
Andriy Dzikh
|
2b3f7cedd7
|
Remove bootstrap from flake_chart.html.
|
2021-06-10 13:02:56 -07:00 |
|
Andriy Dzikh
|
ecaee4d932
|
Add better comments for optimize_data and process_data.
|
2021-06-10 11:16:44 -07:00 |
|
Andriy Dzikh
|
79f8de1bcb
|
Add comment for testEntry.
|
2021-06-10 11:11:34 -07:00 |
|
Andriy Dzikh
|
e9e7b85e02
|
Make types and functions private.
|
2021-06-10 11:08:44 -07:00 |
|
Steven Powell
|
cc89907cca
|
add -Force to folder rm
|
2021-06-10 10:40:49 -07:00 |
|
Andriy Dzikh
|
e089973f65
|
Create SplitEntryMap type to simplify some definitions.
|
2021-06-09 15:21:43 -07:00 |
|
Steven Powell
|
3b27578610
|
delete `minikube-integration` folder in case last test failed to delete it
|
2021-06-09 15:11:03 -07:00 |
|
Andriy Dzikh
|
fb8e4d982b
|
Clean up compute_flake_rate.go.
|
2021-06-08 13:06:28 -07:00 |
|
Andriy Dzikh
|
fcbae7eaa1
|
Make sure gh is present when running report_flakes.sh.
|
2021-06-08 11:54:08 -07:00 |
|
Andriy Dzikh
|
3aa922813c
|
Fix wrong number of parameters for report_flakes.sh.
|
2021-06-08 11:50:14 -07:00 |
|
Andriy Dzikh
|
716f690189
|
Change copyright to 2021.
|
2021-06-07 16:39:06 -07:00 |
|
Andriy Dzikh
|
139d7e3771
|
Fix lints in compute_flake_rate.go and compute_flake_rate_test.go.
|
2021-06-07 16:36:01 -07:00 |
|
Andriy Dzikh
|
8f953781a2
|
Create report_flakes script to comment on PRs about flake rates of failed tests.
|
2021-06-07 14:44:49 -07:00 |
|
Andriy Dzikh
|
7c46154600
|
Rename jenkins_upload_tests.sh to upload_tests.sh.
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
|
2021-06-07 14:12:31 -07:00 |
|
Andriy Dzikh
|
501b238841
|
Use "set -eu -o pipefail" for all scripts.
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
|
2021-06-07 14:09:32 -07:00 |
|
Andriy Dzikh
|
9e7f1ebbf0
|
Make computing flake rates print out percentages (with fixed 2 decimal precision) rather than floats.
|
2021-06-07 13:49:40 -07:00 |
|
Andriy Dzikh
|
a80f3bc5ae
|
Add license to upload_tests script.
|
2021-06-07 13:49:05 -07:00 |
|
Steven Powell
|
b39f171268
|
ensure Windows integration tests are ephemeral
|
2021-06-04 14:08:37 -07:00 |
|
Andriy Dzikh
|
cec82877d8
|
Format flake rates into CSV containing environment, test, and flake rate.
|
2021-06-03 14:25:04 -07:00 |
|
Andriy Dzikh
|
d245cfcdf7
|
Move all flake rate files to Jenkins to allow auto-upload.
|
2021-06-03 14:12:03 -07:00 |
|
Andriy Dzikh
|
40fdbe61ae
|
Allow Jenkins to append to the flake rate data.
|
2021-06-03 14:01:06 -07:00 |
Medya Gh
|
74fe0e9f62
|
bump gopogh
|
2021-06-02 16:30:50 -07:00 |
|
Medya Ghazizadeh
|
db2e02c94f
|
Merge pull request #11448 from sharifelgamal/macos-docker
ci: Add script to make sure docker is running for macos integration tests
|
2021-05-21 13:26:34 -07:00 |
|
Sharif Elgamal
|
40fd08e5fa
|
adding check if docker is already running
|
2021-05-20 15:31:31 -07:00 |
|
Sharif Elgamal
|
2620012bed
|
simplify code a bit
|
2021-05-19 15:00:30 -07:00 |
|
Sharif Elgamal
|
a4c7e5b6dc
|
fix permissions
|
2021-05-19 09:45:04 -07:00 |