Andriy Dzikh
047be99688
Add ROOT_JOB_ID to gopogh details.
2021-07-26 10:23:27 -07:00
Andriy Dzikh
5c16d26379
Add current date to common.ps1 (missing for Windows).
2021-07-26 10:23:27 -07:00
Andriy Dzikh
6c558a9586
Refactor process script to be more readable.
2021-07-26 10:18:01 -07:00
Andriy Dzikh
a0facafa5e
Bump gopogh version from v0.8.0 to v0.9.0.
2021-07-23 15:45:14 -07:00
Andriy Dzikh
16faa3c377
Add by-week flake rate charts.
2021-07-23 13:45:26 -07:00
Andriy Dzikh
a6e5755b24
Add click to sort columns to flake rate table on env page.
2021-07-23 09:16:47 -07:00
Andriy Dzikh
58324bec35
Add links to gopogh logs for each test.
2021-07-22 15:34:25 -07:00
Andriy Dzikh
6ada9a0ebc
Refactor report_flakes sed to make it more readable.
2021-07-22 15:33:33 -07:00
Andriy Dzikh
8afbf67c48
Remove extra bracket in flake rate comment.
2021-07-22 14:33:04 -07:00
Steven Powell
92b7ba0c1e
Merge pull request #11420 from ntkme/fully-qualified-image-name
...
Use fully qualified image name for kicbase image from docker hub
2021-07-21 18:47:42 +00:00
Medya Ghazizadeh
0918511a45
Merge pull request #11986 from andriyDev/fix-flake
...
Fix flake report script not commenting
2021-07-19 18:31:48 -07:00
Medya Ghazizadeh
5d8d7819bf
Merge pull request #12016 from spowelljr/fixBenchmarkOrdering
...
Order time-to-k8s benchmarks from newest to oldest
2021-07-19 18:22:05 -07:00
Medya Ghazizadeh
ca20d21735
Merge pull request #11951 from spowelljr/publicTimeToK8s
...
time-to-k8s Public Charts
2021-07-19 18:20:32 -07:00
Steven Powell
6e591890ed
order benchmarks from newest to oldest
2021-07-19 15:22:17 -07:00
Andriy Dzikh
6176111a5c
Add link to environment pages to flake rate comments.
2021-07-19 13:40:41 -07:00
Andriy Dzikh
7ca1ce55d0
No longer use non-existent ENVIRONMENT variable.
2021-07-17 14:54:42 -07:00
Andriy Dzikh
3d29731932
ls gopogh reports first to ensure they are valid, then cat the valid ones together.
2021-07-17 10:57:18 -07:00
Steven Powell
791c257574
added benchmark for containerd runtime
2021-07-16 16:57:34 -07:00
Medya Ghazizadeh
8f80b5db00
Merge pull request #11918 from andriyDev/UseGoTestSum
...
Use gotestsum for testing output and json output.
2021-07-15 18:18:08 -04:00
Andriy Dzikh
f26764f17a
Move gotestsum installation to common.ps1
2021-07-15 14:42:49 -07:00
Andriy Dzikh
0fe08d715d
Install jq on machines when running sync_tests.sh.
2021-07-15 14:26:02 -07:00
Andriy Dzikh
0692dd1acb
Rename TMP_TOKEN to GH_TOKEN.
2021-07-15 13:19:07 -07:00
Andriy Dzikh
b311c1b665
Replace gh_token.txt with gh auth parsing in release notes.
2021-07-15 13:14:13 -07:00
Andriy Dzikh
b2eec008d4
Use HTTP url instead of ssh url for updating master.
2021-07-15 13:09:02 -07:00
Andriy Dzikh
09a3ce4731
Update golang version for leaderboard.yml.
2021-07-15 12:19:43 -07:00
Andriy Dzikh
031f3331e7
Fix flake report script badly formatted.
2021-07-15 10:54:43 -07:00
Steven Powell
d7cba4886a
fix linting
2021-07-14 10:14:34 -07:00
なつき
4040311f1e
Use fully qualified image name for docker hub fallback image
2021-07-13 16:09:55 -07:00
Steven Powell
2f8ac8c512
change iteration count back to 10 after verifying GitHub Action was successful
2021-07-13 15:32:56 -07:00
Steven Powell
7b50ad492a
generate public charts for time-to-k8s benchmark
2021-07-13 15:02:08 -07:00
Andriy Dzikh
636329eb13
Install gotestsum with sudo.
2021-07-13 14:17:32 -07:00
Andriy Dzikh
25e561a4f7
Create proper installer script for gotestsum.
2021-07-13 14:17:32 -07:00
Andriy Dzikh
b9d6528f26
Use gotestsum for testing output and json output.
2021-07-13 14:17:30 -07:00
Sharif Elgamal
ad74478c78
Merge pull request #11950 from andriyDev/WindowsCommon
...
Create common.ps1 to simplify Windows integration tests
2021-07-13 13:23:11 -07:00
ilya-zuyev
e27dba4f40
Merge pull request #11941 from ilya-zuyev/ilyaz/fix_arm_tests
...
minor fixes in common.sh
2021-07-13 13:19:26 -07:00
Ilya Zuyev
92604a3c00
simplify check_install_golang.sh invocation
2021-07-13 11:47:20 -07:00
Steven Powell
aa92f4106c
Merge pull request #11921 from andriyDev/fix-set-pending-2
...
Use THE_COMMIT env var instead of ghprbActualCommit
2021-07-12 23:58:06 +00:00
Steven Powell
d5e48a2041
Merge pull request #11924 from andriyDev/fix-update-leaderboard
...
Use 'gh auth' to get gh token for leaderboard update
2021-07-12 23:57:48 +00:00
Andriy Dzikh
0589a42fdf
Use -eq instead of == because Powershell bad.
2021-07-12 14:10:50 -07:00
Andriy Dzikh
c64ba2c080
Fix report scripts to print out only started environments, and use quotes around script names.
2021-07-12 10:10:54 -07:00
Andriy Dzikh
b6e55e6c97
Create common.ps1 to simplify Windows integration tests.
2021-07-09 13:27:02 -07:00
Ilya Zuyev
579bebda1a
fix script
2021-07-08 15:00:13 -07:00
Steven Powell
71e4495a76
add cleanup
2021-07-08 14:01:09 -07:00
Ilya Zuyev
baa86c389a
fix scripts
2021-07-08 13:43:10 -07:00
Steven Powell
bb1cffe96a
remove commands handled by the GitHub Action
2021-07-08 13:42:22 -07:00
Steven Powell
853cc04fd2
update time-to-k8s repo
2021-07-08 10:29:19 -07:00
Steven Powell
3403648ddc
update creating PR for time-to-k8s
2021-07-07 16:59:31 -07:00
Andriy Dzikh
74d137e760
Use 'gh auth' to get gh token for leaderboard update.
2021-07-07 15:29:05 -07:00
Steven Powell
bc7995f81b
update contact to Medya
2021-07-07 15:14:53 -07:00
Andriy Dzikh
3afe680c92
Use THE_COMMIT env var instead of ghprbActualCommit.
2021-07-07 13:15:33 -07:00
Andriy Dzikh
50e07ae7ec
Move environment start saving up in minikube_set_pending.
2021-07-07 11:19:35 -07:00
Andriy Dzikh
ae294d2067
Make sync_tests.sh remove any _integration suffix.
2021-07-07 09:21:00 -07:00
Medya Ghazizadeh
429b00d4f0
Merge pull request #11857 from ilya-zuyev/ilyaz/upload_arm64_to_gcs
...
fix kvm2-arm64 scripts
2021-07-02 10:10:27 -04:00
Medya Ghazizadeh
a1300b1d32
Merge pull request #11874 from andriyDev/MoreCharts
...
More charts
2021-07-02 09:45:19 -04:00
Medya Ghazizadeh
5ecd53b1ea
Merge pull request #11794 from ilya-zuyev/ilyaz/test_report_links
...
Show GCS report links in integration test logs
2021-07-02 09:37:14 -04:00
Sharif Elgamal
7c45056827
Merge pull request #11851 from andriyDev/fix-flake-sync
...
Replace integration test "hooks" with standalone scripts
2021-07-01 16:17:54 -07:00
Andriy Dzikh
5d0eba44ec
Add test count/fail count chart to environment page.
2021-07-01 16:02:22 -07:00
Andriy Dzikh
a442d79877
Remove STARTED_ENVIRONMENTS from common.sh.
2021-07-01 15:53:52 -07:00
Andriy Dzikh
d1b6549fbb
Add duration graph to environment flake rates.
2021-07-01 14:29:19 -07:00
Ilya Zuyev
6e46d895dc
Merge branch 'master' into ilyaz/test_report_links
2021-07-01 13:51:14 -07:00
Ilya Zuyev
5ccd38c0f7
fix output formatting
2021-07-01 13:47:40 -07:00
Medya Gh
d2876b1414
auto bump kubernetes version using github actions
2021-07-01 16:32:39 -04:00
Andriy Dzikh
3904c6deab
Ignore upload fail.
2021-07-01 13:32:20 -07:00
Andriy Dzikh
5dfb6726bd
Make upload_tests use a remote GCS file.
2021-07-01 13:32:20 -07:00
Ilya Zuyev
3b5675d9e0
fix
2021-07-01 13:31:44 -07:00
Ilya Zuyev
2beaea9fc1
fix
2021-07-01 12:27:06 -07:00
Ilya Zuyev
ea6d16db41
for PR builds: build kvm2-arm64 deb
2021-07-01 12:14:03 -07:00
Andriy Dzikh
b5caf568ac
Add growth column to flake list.
2021-07-01 12:01:09 -07:00
Andriy Dzikh
d8ffe3f9fa
Add rank column to flake rate list.
2021-07-01 11:47:40 -07:00
Andriy Dzikh
a203d5f644
Replace integration test "hooks" with register_tests to fill started_environments and sync_tests to fill finished environments.
2021-07-01 11:09:34 -07:00
Steven Powell
a9157c2433
improve Windows Docker clean slate
2021-06-30 16:42:09 -07:00
Medya Ghazizadeh
c2f18d9d4b
Merge pull request #11841 from sharifelgamal/ugly-err
...
remove ugly error message from kicbase and ISO autobuild
2021-06-30 17:26:37 -04:00
Sharif Elgamal
d8f8e3faf7
Merge pull request #11803 from sharifelgamal/mac-test
...
try less parallelization for macOS tests
2021-06-30 14:17:48 -07:00
Sharif Elgamal
06c1da3076
make URLs easier to copy
2021-06-30 14:01:14 -07:00
Medya Ghazizadeh
a50406e269
Merge pull request #11767 from ilya-zuyev/ilyaz/arm64_kvm_release
...
Update release scripts to build arm64 version of kvm2 driver
2021-06-30 16:49:09 -04:00
Sharif Elgamal
1e7f8cbaa7
remove ugly error message from kicbase and ISO autobuild
2021-06-30 13:40:18 -07:00
Medya Ghazizadeh
323733c532
Merge pull request #11816 from andriyDev/FlakeRateSync
...
Report flakes only after synchronizing all integration tests
2021-06-30 16:38:08 -04:00
Medya Ghazizadeh
b8596f1a13
Merge pull request #11811 from medyagh/go_mod_godame
...
bump go mod libs manually
2021-06-30 15:50:45 -04:00
Sharif Elgamal
6d75f2e7c8
Merge branch 'master' of github.com:kubernetes/minikube into mac-test
2021-06-29 16:37:54 -07:00
Sharif Elgamal
7030c8c0e4
Merge pull request #11814 from sharifelgamal/fixit
...
fix generate-docs github action
2021-06-29 15:10:08 -07:00
Andriy Dzikh
7ea94ed00a
Add license and comment describing what the script does.
2021-06-29 14:51:31 -07:00
Andriy Dzikh
e3883d0b56
Fix writing wrong files, and added better comments.
2021-06-29 14:47:13 -07:00
Sharif Elgamal
7fabb90eaf
remove old script
2021-06-29 13:56:33 -07:00
Andriy Dzikh
f2c64cdb2b
Add support for syncing Docker_Windows.
2021-06-29 13:32:54 -07:00
Sharif Elgamal
5d11a87a7b
Merge branch 'master' of github.com:kubernetes/minikube into mac-test
2021-06-29 13:27:14 -07:00
Medya Gh
a714161f31
update go-github to v36
2021-06-29 15:46:23 -04:00
Sharif Elgamal
73e42a9a8c
change parallelization in code
2021-06-29 11:46:38 -07:00
Andriy Dzikh
858aab3f55
Create sync_tests.sh to be triggered by each integration test on completion.
2021-06-29 11:44:36 -07:00
Medya Ghazizadeh
cb750c21ba
Merge pull request #11797 from spowelljr/updateTimeToK8sSettingss
...
Make minor changes to time-to-k8s benchmarking
2021-06-29 12:26:28 -04:00
Sharif Elgamal
065929ffd0
try less parallelization for macOS tests
2021-06-29 09:22:42 -07:00
Steven Powell
8b45846088
make minor changes to time-to-k8s benchmarking
2021-06-28 15:25:58 -07:00
Ilya Zuyev
bed20c522b
In integration test logs: show GCS https links to reports
2021-06-28 14:34:05 -07:00
Andriy Dzikh
4f114dafb9
Add comment to report_flakes.sh to see environment flake charts.
2021-06-28 09:19:43 -07:00
Medya Ghazizadeh
4d078ae82f
Merge pull request #11766 from andriyDev/EnvPage
...
Create page with all tests for an environment in flake rate charts
2021-06-25 19:27:00 -04:00
Sharif Elgamal
13d03a588b
idk trying stuff
2021-06-25 15:53:35 -07:00
Sharif Elgamal
bd2a9daa00
let's fix generate_docs for good
2021-06-25 14:12:38 -07:00
Andriy Dzikh
e9932aa7db
Improve error handling to actually render in the UI.
2021-06-25 11:13:46 -07:00
Andriy Dzikh
f57d7ae723
Create loading bar while downloading flake chart data.
2021-06-25 11:05:49 -07:00
Andriy Dzikh
637e8326fd
Implement proper body-by-lines iterator.
2021-06-25 10:47:06 -07:00
Ilya Zuyev
cb31ce2e7d
remove kvm2-arm64 rpm
2021-06-25 10:08:40 -07:00
Andriy Dzikh
eeaf03e4a3
Add name of test to each point in environment flake page.
2021-06-25 09:43:47 -07:00
Andriy Dzikh
b1ec38f808
Add links to charts for each individual test on environment page.
2021-06-25 09:39:13 -07:00
Andriy Dzikh
c067ea6cda
Create table to show all flake rates for a specific environment.
2021-06-25 09:39:13 -07:00
Andriy Dzikh
e22ddb9238
Compute flakeiness based on last 15 days and only chart top 10 flakiest tests.
2021-06-25 09:39:13 -07:00
Andriy Dzikh
9d41adbf06
Create page for viewing all tests for an environment.
2021-06-25 09:39:11 -07:00
Andriy Dzikh
fc6c4eb04e
Move existing formatting/charting code into its own function.
2021-06-25 09:29:54 -07:00
Andriy Dzikh
f404d5976f
Refactor flake chart data processing to simplify into two steps: aggregation and formatting.
2021-06-25 09:26:57 -07:00
Ilya Zuyev
0033bf7ed3
make targets for deb and rpm
2021-06-24 20:02:21 -07:00
Andriy Dzikh
a0c5634dfd
Make nicer fonts for test tooltips in flake charts.
2021-06-24 11:57:07 -07:00
Andriy Dzikh
1c7d6b719c
Add links to hashes in flake charts.
2021-06-24 11:51:00 -07:00
Andriy Dzikh
0ff73cf645
Group commit hashes into one entry rather than one entry per run.
2021-06-24 11:42:50 -07:00
Steven Powell
e3326f88df
finishing last of comments
2021-06-23 15:03:03 -07:00
Steven Powell
0a5aadf502
addressed more comments
2021-06-23 10:42:39 -07:00
Steven Powell
39208c56c4
addressed some of the comments
2021-06-23 09:38:59 -07:00
Andriy Dzikh
fbf61e3e33
Fix running a non-existent command in upload_integration_report.
2021-06-22 14:55:49 -07:00
Sharif Elgamal
055e20c28d
fix generate-docs bugs part 2
2021-06-22 12:58:38 -07:00
Sharif Elgamal
269514601b
better title for PR
2021-06-22 12:27:14 -07:00
Sharif Elgamal
74635e495a
more fixes :)
2021-06-22 10:47:44 -07:00
Sharif Elgamal
23a31d7365
fix generate_docs bugs
2021-06-21 15:35:59 -07:00
Sharif Elgamal
811ff18161
Merge pull request #11677 from sharifelgamal/auto-gen-docs
...
Automatically run `make generate-docs` after every PR merge
2021-06-18 14:30:08 -07:00
minikube-bot
c8fb43220d
remove exit on error
2021-06-18 13:56:02 -07:00
Sharif Elgamal
248942f830
move around check
2021-06-18 13:46:30 -07:00
Sharif Elgamal
1200975bc7
debug
2021-06-18 13:28:01 -07:00
Medya Ghazizadeh
5501afa9ef
Merge pull request #11683 from andriyDev/FixNoFlakesComment
...
Fix flake rates being commented about when no failed tests are present.
2021-06-17 17:58:44 -04:00
Sharif Elgamal
5816b2a0c7
golang 1.6.4
2021-06-17 13:51:37 -07:00
Sharif Elgamal
f8b2ebcc63
do not run workflow if there is no secret
2021-06-17 13:25:13 -07:00
Sharif Elgamal
d37a3e0ba2
make script executable
2021-06-17 12:41:37 -07:00
Sharif Elgamal
c1a7937184
change workflow condition
2021-06-17 12:08:50 -07:00
Medya Ghazizadeh
7d9bcf8626
Merge pull request #11684 from andriyDev/ChangeFlakeColors
...
Update flake chart colors
2021-06-17 13:00:46 -04:00
Medya Ghazizadeh
3c01c8a152
Merge pull request #11675 from andriyDev/FixReportFlakes
...
Stop using sudo for check_install_gh
2021-06-17 13:00:04 -04:00
Andriy Dzikh
300230bd5c
Update flake chart colors.
2021-06-17 09:41:40 -07:00
Andriy Dzikh
5b8b5ce102
Fix flake rates being commented about when no failed tests are present.
2021-06-17 09:28:27 -07:00
Andriy Dzikh
9f601ea393
Fix commenting to a PR instead of an issue.
2021-06-16 18:03:52 -07:00
Sharif Elgamal
c91e981e5f
Merge branch 'master' of github.com:kubernetes/minikube into auto-gen-docs
2021-06-16 16:30:01 -07:00
Andriy Dzikh
c037e5f62f
Stop using sudo for check_install_gh.
2021-06-16 15:29:50 -07:00
Steven Powell
8f019e0418
Merge pull request #11659 from spowelljr/updateTimeToK8s
...
Create automated time-to-k8s benchmarks on release
2021-06-16 20:04:11 +00:00
Sharif Elgamal
7b5381b697
add generate-docs script
2021-06-16 09:23:54 -07:00
Steven Powell
25c5bec652
change back iterations to 5
2021-06-15 10:30:08 -07:00
Steven Powell
599e7c49e9
create automated time-to-k8s benchmarks on release
2021-06-15 10:17:46 -07:00
Andriy Dzikh
231fbee7b5
Fix collect_data_manual not being formatted correctly.
2021-06-15 09:55:32 -07:00
Medya Ghazizadeh
6a9076391d
Merge pull request #11602 from andriyDev/Flakes
...
Create a system for generating public flake rate reporting.
2021-06-15 12:51:29 -04:00
Sharif Elgamal
76d74191d8
Merge pull request #11623 from sharifelgamal/1.21.0
...
Bump Makefile for 1.21.0 release
2021-06-11 08:46:19 -07:00
Andriy Dzikh
1c1fdbff42
Make compute_flake_rate also compute average test duration.
2021-06-10 14:00:47 -07:00
Andriy Dzikh
728229c719
Add more environments to the allowed environments for commenting.
2021-06-10 13:36:23 -07:00
Andriy Dzikh
dc6cb0b671
Rename collect_data.sh to collect_data_manual.sh and make header comment more clear.
2021-06-10 13:30:35 -07:00
Andriy Dzikh
884216db9e
Make report_flakes.sh abort if there are no failed tests.
2021-06-10 13:27:00 -07:00
Andriy Dzikh
7e785c1c1e
Make collect_data.sh optimzie and upload to GCS automatically.
2021-06-10 13:19:05 -07:00
Andriy Dzikh
a98db3511e
Add description and example usage to all shell scripts.
2021-06-10 13:16:16 -07:00
Andriy Dzikh
2b3f7cedd7
Remove bootstrap from flake_chart.html.
2021-06-10 13:02:56 -07:00
Sharif Elgamal
79e1b4e99d
Bump Makefile for 1.21.0 release
2021-06-10 11:34:06 -07:00
Andriy Dzikh
ecaee4d932
Add better comments for optimize_data and process_data.
2021-06-10 11:16:44 -07:00
Andriy Dzikh
79f8de1bcb
Add comment for testEntry.
2021-06-10 11:11:34 -07:00
Andriy Dzikh
e9e7b85e02
Make types and functions private.
2021-06-10 11:08:44 -07:00
Steven Powell
cc89907cca
add -Force to folder rm
2021-06-10 10:40:49 -07:00
Andriy Dzikh
e089973f65
Create SplitEntryMap type to simplify some definitions.
2021-06-09 15:21:43 -07:00
Steven Powell
3b27578610
delete `minikube-integration` folder in case last test failed to delete it
2021-06-09 15:11:03 -07:00
Andriy Dzikh
fb8e4d982b
Clean up compute_flake_rate.go.
2021-06-08 13:06:28 -07:00
Andriy Dzikh
fcbae7eaa1
Make sure gh is present when running report_flakes.sh.
2021-06-08 11:54:08 -07:00
Andriy Dzikh
3aa922813c
Fix wrong number of parameters for report_flakes.sh.
2021-06-08 11:50:14 -07:00
Andriy Dzikh
716f690189
Change copyright to 2021.
2021-06-07 16:39:06 -07:00
Andriy Dzikh
139d7e3771
Fix lints in compute_flake_rate.go and compute_flake_rate_test.go.
2021-06-07 16:36:01 -07:00
Andriy Dzikh
8f953781a2
Create report_flakes script to comment on PRs about flake rates of failed tests.
2021-06-07 14:44:49 -07:00
Andriy Dzikh
7c46154600
Rename jenkins_upload_tests.sh to upload_tests.sh.
...
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
2021-06-07 14:12:31 -07:00
Andriy Dzikh
501b238841
Use "set -eu -o pipefail" for all scripts.
...
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
2021-06-07 14:09:32 -07:00
Andriy Dzikh
9e7f1ebbf0
Make computing flake rates print out percentages (with fixed 2 decimal precision) rather than floats.
2021-06-07 13:49:40 -07:00
Andriy Dzikh
a80f3bc5ae
Add license to upload_tests script.
2021-06-07 13:49:05 -07:00
Steven Powell
b39f171268
ensure Windows integration tests are ephemeral
2021-06-04 14:08:37 -07:00
Andriy Dzikh
cec82877d8
Format flake rates into CSV containing environment, test, and flake rate.
2021-06-03 14:25:04 -07:00
Andriy Dzikh
d245cfcdf7
Move all flake rate files to Jenkins to allow auto-upload.
2021-06-03 14:12:03 -07:00
Andriy Dzikh
40fdbe61ae
Allow Jenkins to append to the flake rate data.
2021-06-03 14:01:06 -07:00
Andriy Dzikh
d7d3593a89
Rewrite process_data.sh to no longer depend on git log.
...
This now means we depend on the date being contained within the details.
2021-06-03 13:38:44 -07:00
Medya Gh
74fe0e9f62
bump gopogh
2021-06-02 16:30:50 -07:00
Andriy Dzikh
65be305aab
Add test for ComputeFlakeRates.
2021-06-02 16:17:39 -07:00
Andriy Dzikh
df6f7a8485
Add test for FilterRecentEntries.
2021-06-02 15:48:12 -07:00
Andriy Dzikh
4e9718a28b
Add test for SplitData.
2021-06-02 14:15:25 -07:00
Andriy Dzikh
401bcbfe0a
Move comparison code to its own function.
2021-06-02 14:12:43 -07:00
Andriy Dzikh
9d4153f0ab
Create test for ReadData.
2021-06-02 14:00:01 -07:00
Andriy Dzikh
60929009d6
Create FilterRecentEntries to only include the last N run dates.
2021-06-02 11:01:33 -07:00
Andriy Dzikh
e6a553f679
Compute flake rate of all entries split by environment and test.
2021-06-02 11:00:40 -07:00
Andriy Dzikh
de6cff23db
Split entries based on environment and test name.
2021-06-02 11:00:40 -07:00
Andriy Dzikh
ef33b8661c
Create new compute_flake_rate.go with basic CSV parsing.
2021-06-02 11:00:38 -07:00
Andriy Dzikh
fbf4e03eb9
Add license to sh scripts.
2021-06-01 14:06:54 -07:00
Andriy Dzikh
78e9838283
Refactor collect_data into collect_data + process_data.
...
This allows processing data coming from other sources.
2021-06-01 14:02:06 -07:00
Andriy Dzikh
419f2506e6
Add "data optimization" which treats empty fields in data.csv as equivalent to the previous entry.
...
This optimization takes data size down from 41 MB to 16MB which is ~40% which is huge!
2021-06-01 12:15:16 -07:00
Andriy Dzikh
424c954770
Add duration to existing graph with appropriate labels.
2021-06-01 11:33:22 -07:00
Andriy Dzikh
b55c6726ef
Use URL search query to select test and environment.
2021-06-01 10:18:26 -07:00
Andriy Dzikh
ae62edbd18
Update JS to accept duration data.
2021-06-01 10:17:29 -07:00
Andriy Dzikh
b5151a6d89
Add duration to data collection.
2021-06-01 09:46:14 -07:00
Andriy Dzikh
f9f3ef9a09
Pass driverName into Preload and PreloadExists to report no preload for BareMetal.
2021-05-27 15:02:00 -07:00
Steven Powell
ee5faa6fc4
Merge branch 'master' into automateTimeToK8s
2021-05-26 16:45:13 -07:00
Steven Powell
913d096d03
add note to release notes to remind to run `make time-to-k8s-benchmark`
2021-05-26 16:44:21 -07:00
Steven Powell
766cfd1e76
add copyright boilerplate
2021-05-26 16:26:45 -07:00
Steven Powell
c30dbb0ead
clean up var init
2021-05-26 15:59:50 -07:00
Steven Powell
2530048689
removed unused consts
2021-05-26 15:50:36 -07:00
Steven Powell
a81761ea4a
add make command to auto benchmark time-to-k8s and update website
2021-05-26 15:45:11 -07:00
Andriy Dzikh
2e5ea59774
Refactor data cleaning.
2021-05-26 09:36:44 -07:00
Andriy Dzikh
328d54ef63
Create first flake rate chart.
2021-05-25 16:20:56 -07:00
Andriy Dzikh
b45b4c9a0b
Include Google Charts. Refactor to wait for Google Charts and test data loading at the same time.
2021-05-25 13:42:53 -07:00
Andriy Dzikh
b33e272435
Create basic parsing of CSV test data.
2021-05-25 13:42:12 -07:00
Andriy Dzikh
abdbfa63b6
Create initial HTML and JS for flake rate site.
2021-05-25 11:40:08 -07:00
Andriy Dzikh
79c2a51f65
Change update leaderboard message to use make target instead of shell script.
2021-05-24 09:53:46 -07:00
Andriy Dzikh
63f0f8774b
Create script to collect log data.
2021-05-24 09:28:11 -07:00
Andriy Dzikh
0fe0c11c56
Add message to view contributions leaderboard to release_notes.sh.
2021-05-21 16:28:25 -07:00
Medya Ghazizadeh
db2e02c94f
Merge pull request #11448 from sharifelgamal/macos-docker
...
ci: Add script to make sure docker is running for macos integration tests
2021-05-21 13:26:34 -07:00
Medya Ghazizadeh
5e101c7605
Merge pull request #11467 from andriyDev/PublishPullsheetLeaderboard
...
Publish pullsheet leaderboard to website
2021-05-21 11:25:57 -07:00
Medya Ghazizadeh
b76766d079
Merge pull request #11447 from ilya-zuyev/ilyaz/gh_actions_cleanup
...
add GitHub Actions cleanup scripts
2021-05-21 09:18:04 -07:00
Sharif Elgamal
40fd08e5fa
adding check if docker is already running
2021-05-20 15:31:31 -07:00
Andriy Dzikh
0913c02127
Fix update_contributions not working correctly on Mac (Mac sed does not have execute command).
2021-05-20 11:54:04 -07:00
Andriy Dzikh
c04f2d731f
Add message to hack/release_notes.sh to tell maintainers to update contributions.
2021-05-20 09:44:12 -07:00
Andriy Dzikh
117e1495fa
Create script to update contributions page.
2021-05-20 09:25:26 -07:00
Sharif Elgamal
2620012bed
simplify code a bit
2021-05-19 15:00:30 -07:00
Ilya Zuyev
e6dc7243f3
add comments
2021-05-19 14:53:04 -07:00
Sharif Elgamal
a4c7e5b6dc
fix permissions
2021-05-19 09:45:04 -07:00
Ilya Zuyev
b78415fcd0
add logs
2021-05-18 22:04:25 -07:00
Ilya Zuyev
443c0c00a1
add logs
2021-05-18 22:03:57 -07:00
Ilya Zuyev
6da92d44f6
Fix golang installation script for arm64 platform
2021-05-18 22:00:57 -07:00
Ilya Zuyev
39f7db8783
check if cron rule is already installed
2021-05-18 19:18:45 -07:00
Ilya Zuyev
8f213df9a7
update workflow
2021-05-18 17:27:45 -07:00
Ilya Zuyev
246a2e55d5
fix boilerplate
2021-05-18 17:21:08 -07:00
Ilya Zuyev
c2f8e17d2f
fix boilerplate
2021-05-18 17:05:03 -07:00
Sharif Elgamal
f319ac784c
Add script to make sure docker is running for macos integration tests
2021-05-18 16:54:09 -07:00
Ilya Zuyev
4ab318e604
add GitHub Actions cleanup scripts
2021-05-18 16:12:04 -07:00
Predrag Rogic
f425739254
prevent kube-proxy trying to change nf_conntrack_max
2021-05-15 19:36:49 +01:00
Sharif Elgamal
c68216acd8
Merge pull request #11402 from sharifelgamal/storage-prov
...
add script to automatically release storage provisioner
2021-05-14 12:25:38 -07:00
Sharif Elgamal
468e2e85bb
git username
2021-05-13 10:43:55 -07:00
Sharif Elgamal
ad4716813a
fix if statements
2021-05-13 10:16:04 -07:00
Sharif Elgamal
98e7cbf4d3
perms
2021-05-13 10:12:12 -07:00
Sharif Elgamal
3a2bad6d28
don't automatically bump version
2021-05-13 09:51:31 -07:00
Sharif Elgamal
3042313322
don't fail on docker error
2021-05-13 09:42:51 -07:00
Sharif Elgamal
edd1230767
add script to automatically release storage provisioner
2021-05-13 09:40:55 -07:00
Andriy Dzikh
48b7dea2b5
Add flags to pullsheet to prevent Info and Warning logs in stderr.
2021-05-13 09:12:47 -07:00
Medya Ghazizadeh
0b58021952
Merge pull request #11377 from andriyDev/FixReleaseNotesOnMac
...
Refactor hack/release_notes.sh pullsheet commands and use sort instead of awk sorting
2021-05-12 13:00:02 -07:00
Medya Ghazizadeh
9e57c747e2
Merge pull request #11351 from afbjorklund/go-1.16.4
...
Upgrade go version from 1.16.1 to 1.16.4
2021-05-11 14:53:49 -07:00
Medya Ghazizadeh
c136fe3cfd
Merge pull request #11060 from afbjorklund/retro-arch
...
Allow building minikube for outdated architectures
2021-05-11 12:22:03 -07:00
Andriy Dzikh
02b9fd7d7e
Refactor hack/release_notes.sh pullsheet commands and use sort instead of awk sorting.
2021-05-11 11:41:48 -07:00
Anders F Björklund
118d201a73
Upgrade go version from 1.16.1 to 1.16.4
2021-05-10 07:16:24 +02:00
Anders F Björklund
ac624bff80
Add missing arm64 tarballs to the release page
...
The arm64 build targets for the drivers are currently missing,
but they should be downloaded at runtime anyway so exclude them.
2021-05-09 10:11:22 +02:00
Sharif Elgamal
fea1be9d51
unify integration test names for uploading
2021-05-07 15:35:38 -07:00
Sharif Elgamal
603e49189e
allow install docker to fail
2021-05-07 10:07:08 -07:00
Sharif Elgamal
290230831e
break OS_ARCH into OS and ARCH
2021-05-06 16:23:41 -07:00
Sharif Elgamal
73291c04c7
make common executable
2021-05-06 13:06:12 -07:00
Sharif Elgamal
ad885687de
actually common.sh is a better choice
2021-05-06 13:05:02 -07:00
Sharif Elgamal
63b773e88b
combine run_tests.sh and common.sh for integration testing
2021-05-06 12:43:16 -07:00
Sharif Elgamal
be24532339
fix other API instances of access token for tests
2021-05-05 15:53:36 -07:00
Sharif Elgamal
90d148faa7
change authentication for jenkins job
2021-05-05 14:15:33 -07:00
Sharif Elgamal
4184a9d02d
Merge pull request #10927 from sharifelgamal/macstadium
...
ci: Re-enable integration testing for macOS
2021-05-04 17:58:14 -07:00
Andriy Dzikh
f7e5b6b422
Add a link in hack/release_notes.sh to the changelog for more details.
2021-05-04 16:16:56 -07:00
Andriy Dzikh
13b3aae355
Thank issue-commenters in hack/release_notes.sh.
2021-05-04 15:01:17 -07:00
Andriy Dzikh
83dc6be81c
Thank PR reviewers in hack/release_notes.sh.
2021-05-04 14:56:38 -07:00
Steven Powell
2be9109797
fixed CPU benchmarking typos and small formatting
2021-05-04 12:48:04 -07:00
Sharif Elgamal
cdb0de091a
full suite for docker
2021-05-04 12:16:13 -07:00
Sharif Elgamal
debca7805e
i just wanna see if it works ok
2021-05-04 11:07:36 -07:00
Sharif Elgamal
7a4855df80
take 2
2021-05-04 10:42:09 -07:00
Sharif Elgamal
3daad34d4e
fix up loop
2021-05-04 10:01:52 -07:00
Sharif Elgamal
384cb73b35
add ability for custom file name for uploading files
2021-05-03 17:53:39 -07:00
Sharif Elgamal
4f381cc1e6
Merge branch 'master' of github.com:kubernetes/minikube into macstadium
2021-05-03 17:30:20 -07:00
Sharif Elgamal
4186087e64
Revert "Run test2json during the test and not afterwards"
2021-05-03 17:23:24 -07:00
Sharif Elgamal
c14051eb35
add pidof to macos machines
2021-05-03 16:43:01 -07:00
Sharif Elgamal
a08f44b746
make hyperkit tests full suite
2021-05-03 15:45:47 -07:00
Sharif Elgamal
b090f4901c
make sure timeout is installed on macos
2021-05-03 13:27:11 -07:00
Sharif Elgamal
17d677dfc9
small changes
2021-05-03 13:21:56 -07:00
Anders F Björklund
b4379c326f
Run test2json during the test and not afterwards
...
Running it after the test is completed, means that the timestamps
of the output will be wrong (not reflecting the actual test run).
This should use "go test -json" instead of the "test2json" pipe,
but need something like "gotestsum" to show both out and json...
2021-05-03 08:08:14 +02:00
Steven Powell
82e9a5248a
fixed gsutil copy from releases-beta.json
2021-04-30 17:22:21 -07:00
Sharif Elgamal
7cce80e555
trying hyperkit??
2021-04-30 11:24:27 -07:00
Sharif Elgamal
bb9fa3d120
hey, uh, don't kill docker please
2021-04-30 10:44:09 -07:00
Sharif Elgamal
d9d251ac38
use external upload script
2021-04-30 08:20:24 -07:00
Sharif Elgamal
f26b2df8c3
install pstree on macos as well
2021-04-29 16:36:00 -07:00
Sharif Elgamal
eb3f2b7516
Merge branch 'master' of github.com:kubernetes/minikube into macstadium
2021-04-29 16:16:20 -07:00
Medya Ghazizadeh
fe0a1774a6
Merge pull request #11140 from govargo/add-cpu-benchmark
...
Add cpu usage benchmark command `make cpu-benchmark` and website docs
2021-04-29 15:16:01 -07:00
Kenta Iso
43b1dfd433
Change barChart color and add benchmark description to docs of benchmark
2021-04-30 06:41:44 +09:00
Medya Ghazizadeh
ac2b98d744
Merge pull request #11169 from spowelljr/addBetaNotifications
...
Add opt-in notifications for beta releases
2021-04-29 14:03:59 -07:00
Kent Iso
e3fd45d079
Update linux auto-pause result with improved method
2021-04-29 20:05:59 +00:00
Kent Iso
6f0391738c
Improve verify auto pause step and Update README.md for auto-pause benchmark
2021-04-29 19:56:06 +00:00
Sharif Elgamal
77dd7a7cd6
Merge branch 'master' of github.com:kubernetes/minikube into macstadium
2021-04-28 18:56:24 -07:00
Sharif Elgamal
a3b52560cd
that was a bad idea
2021-04-28 18:49:24 -07:00
Sharif Elgamal
7ed18e5811
try to propagate sudo creds
2021-04-28 18:21:24 -07:00
Kenta Iso
ad7b7fa584
Add verify step for control plane Paused status for cpu benchmark
2021-04-29 05:02:41 +09:00
Kent Iso
a981e81f9c
Update README about cpu-benchmark
2021-04-29 01:06:27 +09:00
Kent Iso
67da2c88ce
Fix lint error
2021-04-29 01:06:27 +09:00
Kent Iso
52ddca0ea4
divide idle only benchmark and autopause benchmark of cpu usage
2021-04-29 01:06:27 +09:00
Kent Iso
a6fdc2f8ea
Add data label to bar chart
2021-04-29 01:06:26 +09:00
Kent Iso
288eb00810
Add linux cpu benchmark image
2021-04-29 01:06:26 +09:00
Kent Iso
7fe94b5876
Add minikube docker with auto-pause to cpu benchmark
2021-04-29 01:06:26 +09:00
Kent Iso
45a867d3b8
Add cpu usage benchmark
2021-04-29 01:06:26 +09:00
Steven Powell
285457ebda
updated releases script to updates releases-beta.json
2021-04-27 13:34:08 -07:00
Sharif Elgamal
0ed1c923a9
Make sure to capture errors in auto kicbase builds
2021-04-26 17:54:07 -07:00
Predrag Rogic
79ba91cd44
fix flake integration tests: cleanups and timeouts
2021-04-23 22:19:59 +01:00
Medya Ghazizadeh
6f97066217
Merge pull request #11095 from ilya-zuyev/ilyaz/preloads_jenkins_job
...
Move preload generation to Jenkins
2021-04-23 13:25:18 -07:00
Ilya Zuyev
71ba8c19bb
add comments
2021-04-20 11:44:29 -07:00
Medya Ghazizadeh
6ad8cd7d22
Merge pull request #11030 from prezha/fix-insufficient-memory
...
fix insufficient memory issues
2021-04-20 09:52:30 -07:00
Medya Gh
1207de734b
bump golang lint ci to latest
2021-04-19 15:16:31 -07:00
Anders F Björklund
9fded7695f
Add retro binaries to the all target and release
2021-04-18 13:10:50 +02:00
Ilya Zuyev
739424c5ac
reorder k8s versions to process
2021-04-16 13:00:41 -07:00
Ilya Zuyev
bf5d87423a
fix comments
2021-04-16 10:52:16 -07:00
Ilya Zuyev
e0c3ef3f51
improve logs
2021-04-16 10:41:07 -07:00
Ilya Zuyev
9af84a7d95
debug options
2021-04-15 10:40:43 -07:00
Ilya Zuyev
74c1029d9f
more logs
2021-04-14 14:01:41 -07:00
Ilya Zuyev
ce748474fb
more logs
2021-04-14 13:59:42 -07:00
Ilya Zuyev
06c4bf030f
goimports
2021-04-13 13:24:57 -07:00
Ilya Zuyev
71080b0860
add command line options to preload-generator
2021-04-13 12:18:44 -07:00