Commit Graph

1515 Commits (910fe36c0741c449c7c614219f9f90edcc3897ef)

Author SHA1 Message Date
Andriy Dzikh 047be99688 Add ROOT_JOB_ID to gopogh details. 2021-07-26 10:23:27 -07:00
Andriy Dzikh 5c16d26379 Add current date to common.ps1 (missing for Windows). 2021-07-26 10:23:27 -07:00
Andriy Dzikh 6c558a9586 Refactor process script to be more readable. 2021-07-26 10:18:01 -07:00
Andriy Dzikh a0facafa5e Bump gopogh version from v0.8.0 to v0.9.0. 2021-07-23 15:45:14 -07:00
Andriy Dzikh 16faa3c377 Add by-week flake rate charts. 2021-07-23 13:45:26 -07:00
Andriy Dzikh a6e5755b24 Add click to sort columns to flake rate table on env page. 2021-07-23 09:16:47 -07:00
Andriy Dzikh 58324bec35 Add links to gopogh logs for each test. 2021-07-22 15:34:25 -07:00
Andriy Dzikh 6ada9a0ebc Refactor report_flakes sed to make it more readable. 2021-07-22 15:33:33 -07:00
Andriy Dzikh 8afbf67c48 Remove extra bracket in flake rate comment. 2021-07-22 14:33:04 -07:00
Steven Powell 92b7ba0c1e
Merge pull request #11420 from ntkme/fully-qualified-image-name
Use fully qualified image name for kicbase image from docker hub
2021-07-21 18:47:42 +00:00
Medya Ghazizadeh 0918511a45
Merge pull request #11986 from andriyDev/fix-flake
Fix flake report script not commenting
2021-07-19 18:31:48 -07:00
Medya Ghazizadeh 5d8d7819bf
Merge pull request #12016 from spowelljr/fixBenchmarkOrdering
Order time-to-k8s benchmarks from newest to oldest
2021-07-19 18:22:05 -07:00
Medya Ghazizadeh ca20d21735
Merge pull request #11951 from spowelljr/publicTimeToK8s
time-to-k8s Public Charts
2021-07-19 18:20:32 -07:00
Steven Powell 6e591890ed order benchmarks from newest to oldest 2021-07-19 15:22:17 -07:00
Andriy Dzikh 6176111a5c Add link to environment pages to flake rate comments. 2021-07-19 13:40:41 -07:00
Andriy Dzikh 7ca1ce55d0 No longer use non-existent ENVIRONMENT variable. 2021-07-17 14:54:42 -07:00
Andriy Dzikh 3d29731932 ls gopogh reports first to ensure they are valid, then cat the valid ones together. 2021-07-17 10:57:18 -07:00
Steven Powell 791c257574 added benchmark for containerd runtime 2021-07-16 16:57:34 -07:00
Medya Ghazizadeh 8f80b5db00
Merge pull request #11918 from andriyDev/UseGoTestSum
Use gotestsum for testing output and json output.
2021-07-15 18:18:08 -04:00
Andriy Dzikh f26764f17a Move gotestsum installation to common.ps1 2021-07-15 14:42:49 -07:00
Andriy Dzikh 0fe08d715d Install jq on machines when running sync_tests.sh. 2021-07-15 14:26:02 -07:00
Andriy Dzikh 0692dd1acb Rename TMP_TOKEN to GH_TOKEN. 2021-07-15 13:19:07 -07:00
Andriy Dzikh b311c1b665 Replace gh_token.txt with gh auth parsing in release notes. 2021-07-15 13:14:13 -07:00
Andriy Dzikh b2eec008d4 Use HTTP url instead of ssh url for updating master. 2021-07-15 13:09:02 -07:00
Andriy Dzikh 09a3ce4731 Update golang version for leaderboard.yml. 2021-07-15 12:19:43 -07:00
Andriy Dzikh 031f3331e7 Fix flake report script badly formatted. 2021-07-15 10:54:43 -07:00
Steven Powell d7cba4886a fix linting 2021-07-14 10:14:34 -07:00
なつき 4040311f1e Use fully qualified image name for docker hub fallback image 2021-07-13 16:09:55 -07:00
Steven Powell 2f8ac8c512 change iteration count back to 10 after verifying GitHub Action was successful 2021-07-13 15:32:56 -07:00
Steven Powell 7b50ad492a generate public charts for time-to-k8s benchmark 2021-07-13 15:02:08 -07:00
Andriy Dzikh 636329eb13 Install gotestsum with sudo. 2021-07-13 14:17:32 -07:00
Andriy Dzikh 25e561a4f7 Create proper installer script for gotestsum. 2021-07-13 14:17:32 -07:00
Andriy Dzikh b9d6528f26 Use gotestsum for testing output and json output. 2021-07-13 14:17:30 -07:00
Sharif Elgamal ad74478c78
Merge pull request #11950 from andriyDev/WindowsCommon
Create common.ps1 to simplify Windows integration tests
2021-07-13 13:23:11 -07:00
ilya-zuyev e27dba4f40
Merge pull request #11941 from ilya-zuyev/ilyaz/fix_arm_tests
minor fixes in common.sh
2021-07-13 13:19:26 -07:00
Ilya Zuyev 92604a3c00 simplify check_install_golang.sh invocation 2021-07-13 11:47:20 -07:00
Steven Powell aa92f4106c
Merge pull request #11921 from andriyDev/fix-set-pending-2
Use THE_COMMIT env var instead of ghprbActualCommit
2021-07-12 23:58:06 +00:00
Steven Powell d5e48a2041
Merge pull request #11924 from andriyDev/fix-update-leaderboard
Use 'gh auth' to get gh token for leaderboard update
2021-07-12 23:57:48 +00:00
Andriy Dzikh 0589a42fdf Use -eq instead of == because Powershell bad. 2021-07-12 14:10:50 -07:00
Andriy Dzikh c64ba2c080 Fix report scripts to print out only started environments, and use quotes around script names. 2021-07-12 10:10:54 -07:00
Andriy Dzikh b6e55e6c97 Create common.ps1 to simplify Windows integration tests. 2021-07-09 13:27:02 -07:00
Ilya Zuyev 579bebda1a fix script 2021-07-08 15:00:13 -07:00
Steven Powell 71e4495a76 add cleanup 2021-07-08 14:01:09 -07:00
Ilya Zuyev baa86c389a fix scripts 2021-07-08 13:43:10 -07:00
Steven Powell bb1cffe96a remove commands handled by the GitHub Action 2021-07-08 13:42:22 -07:00
Steven Powell 853cc04fd2 update time-to-k8s repo 2021-07-08 10:29:19 -07:00
Steven Powell 3403648ddc update creating PR for time-to-k8s 2021-07-07 16:59:31 -07:00
Andriy Dzikh 74d137e760 Use 'gh auth' to get gh token for leaderboard update. 2021-07-07 15:29:05 -07:00
Steven Powell bc7995f81b update contact to Medya 2021-07-07 15:14:53 -07:00
Andriy Dzikh 3afe680c92 Use THE_COMMIT env var instead of ghprbActualCommit. 2021-07-07 13:15:33 -07:00
Andriy Dzikh 50e07ae7ec Move environment start saving up in minikube_set_pending. 2021-07-07 11:19:35 -07:00
Andriy Dzikh ae294d2067 Make sync_tests.sh remove any _integration suffix. 2021-07-07 09:21:00 -07:00
Medya Ghazizadeh 429b00d4f0
Merge pull request #11857 from ilya-zuyev/ilyaz/upload_arm64_to_gcs
fix kvm2-arm64 scripts
2021-07-02 10:10:27 -04:00
Medya Ghazizadeh a1300b1d32
Merge pull request #11874 from andriyDev/MoreCharts
More charts
2021-07-02 09:45:19 -04:00
Medya Ghazizadeh 5ecd53b1ea
Merge pull request #11794 from ilya-zuyev/ilyaz/test_report_links
Show GCS report links in integration test logs
2021-07-02 09:37:14 -04:00
Sharif Elgamal 7c45056827
Merge pull request #11851 from andriyDev/fix-flake-sync
Replace integration test "hooks" with standalone scripts
2021-07-01 16:17:54 -07:00
Andriy Dzikh 5d0eba44ec Add test count/fail count chart to environment page. 2021-07-01 16:02:22 -07:00
Andriy Dzikh a442d79877 Remove STARTED_ENVIRONMENTS from common.sh. 2021-07-01 15:53:52 -07:00
Andriy Dzikh d1b6549fbb Add duration graph to environment flake rates. 2021-07-01 14:29:19 -07:00
Ilya Zuyev 6e46d895dc Merge branch 'master' into ilyaz/test_report_links 2021-07-01 13:51:14 -07:00
Ilya Zuyev 5ccd38c0f7 fix output formatting 2021-07-01 13:47:40 -07:00
Medya Gh d2876b1414 auto bump kubernetes version using github actions 2021-07-01 16:32:39 -04:00
Andriy Dzikh 3904c6deab Ignore upload fail. 2021-07-01 13:32:20 -07:00
Andriy Dzikh 5dfb6726bd Make upload_tests use a remote GCS file. 2021-07-01 13:32:20 -07:00
Ilya Zuyev 3b5675d9e0 fix 2021-07-01 13:31:44 -07:00
Ilya Zuyev 2beaea9fc1 fix 2021-07-01 12:27:06 -07:00
Ilya Zuyev ea6d16db41 for PR builds: build kvm2-arm64 deb 2021-07-01 12:14:03 -07:00
Andriy Dzikh b5caf568ac Add growth column to flake list. 2021-07-01 12:01:09 -07:00
Andriy Dzikh d8ffe3f9fa Add rank column to flake rate list. 2021-07-01 11:47:40 -07:00
Andriy Dzikh a203d5f644 Replace integration test "hooks" with register_tests to fill started_environments and sync_tests to fill finished environments. 2021-07-01 11:09:34 -07:00
Steven Powell a9157c2433 improve Windows Docker clean slate 2021-06-30 16:42:09 -07:00
Medya Ghazizadeh c2f18d9d4b
Merge pull request #11841 from sharifelgamal/ugly-err
remove ugly error message from kicbase and ISO autobuild
2021-06-30 17:26:37 -04:00
Sharif Elgamal d8f8e3faf7
Merge pull request #11803 from sharifelgamal/mac-test
try less parallelization for macOS tests
2021-06-30 14:17:48 -07:00
Sharif Elgamal 06c1da3076 make URLs easier to copy 2021-06-30 14:01:14 -07:00
Medya Ghazizadeh a50406e269
Merge pull request #11767 from ilya-zuyev/ilyaz/arm64_kvm_release
Update release scripts to build arm64 version of kvm2 driver
2021-06-30 16:49:09 -04:00
Sharif Elgamal 1e7f8cbaa7 remove ugly error message from kicbase and ISO autobuild 2021-06-30 13:40:18 -07:00
Medya Ghazizadeh 323733c532
Merge pull request #11816 from andriyDev/FlakeRateSync
Report flakes only after synchronizing all integration tests
2021-06-30 16:38:08 -04:00
Medya Ghazizadeh b8596f1a13
Merge pull request #11811 from medyagh/go_mod_godame
bump go mod libs manually
2021-06-30 15:50:45 -04:00
Sharif Elgamal 6d75f2e7c8 Merge branch 'master' of github.com:kubernetes/minikube into mac-test 2021-06-29 16:37:54 -07:00
Sharif Elgamal 7030c8c0e4
Merge pull request #11814 from sharifelgamal/fixit
fix generate-docs github action
2021-06-29 15:10:08 -07:00
Andriy Dzikh 7ea94ed00a Add license and comment describing what the script does. 2021-06-29 14:51:31 -07:00
Andriy Dzikh e3883d0b56 Fix writing wrong files, and added better comments. 2021-06-29 14:47:13 -07:00
Sharif Elgamal 7fabb90eaf remove old script 2021-06-29 13:56:33 -07:00
Andriy Dzikh f2c64cdb2b Add support for syncing Docker_Windows. 2021-06-29 13:32:54 -07:00
Sharif Elgamal 5d11a87a7b Merge branch 'master' of github.com:kubernetes/minikube into mac-test 2021-06-29 13:27:14 -07:00
Medya Gh a714161f31 update go-github to v36 2021-06-29 15:46:23 -04:00
Sharif Elgamal 73e42a9a8c change parallelization in code 2021-06-29 11:46:38 -07:00
Andriy Dzikh 858aab3f55 Create sync_tests.sh to be triggered by each integration test on completion. 2021-06-29 11:44:36 -07:00
Medya Ghazizadeh cb750c21ba
Merge pull request #11797 from spowelljr/updateTimeToK8sSettingss
Make minor changes to time-to-k8s benchmarking
2021-06-29 12:26:28 -04:00
Sharif Elgamal 065929ffd0 try less parallelization for macOS tests 2021-06-29 09:22:42 -07:00
Steven Powell 8b45846088 make minor changes to time-to-k8s benchmarking 2021-06-28 15:25:58 -07:00
Ilya Zuyev bed20c522b In integration test logs: show GCS https links to reports 2021-06-28 14:34:05 -07:00
Andriy Dzikh 4f114dafb9 Add comment to report_flakes.sh to see environment flake charts. 2021-06-28 09:19:43 -07:00
Medya Ghazizadeh 4d078ae82f
Merge pull request #11766 from andriyDev/EnvPage
Create page with all tests for an environment in flake rate charts
2021-06-25 19:27:00 -04:00
Sharif Elgamal 13d03a588b idk trying stuff 2021-06-25 15:53:35 -07:00
Sharif Elgamal bd2a9daa00 let's fix generate_docs for good 2021-06-25 14:12:38 -07:00
Andriy Dzikh e9932aa7db Improve error handling to actually render in the UI. 2021-06-25 11:13:46 -07:00
Andriy Dzikh f57d7ae723 Create loading bar while downloading flake chart data. 2021-06-25 11:05:49 -07:00
Andriy Dzikh 637e8326fd Implement proper body-by-lines iterator. 2021-06-25 10:47:06 -07:00
Ilya Zuyev cb31ce2e7d remove kvm2-arm64 rpm 2021-06-25 10:08:40 -07:00
Andriy Dzikh eeaf03e4a3 Add name of test to each point in environment flake page. 2021-06-25 09:43:47 -07:00
Andriy Dzikh b1ec38f808 Add links to charts for each individual test on environment page. 2021-06-25 09:39:13 -07:00
Andriy Dzikh c067ea6cda Create table to show all flake rates for a specific environment. 2021-06-25 09:39:13 -07:00
Andriy Dzikh e22ddb9238 Compute flakeiness based on last 15 days and only chart top 10 flakiest tests. 2021-06-25 09:39:13 -07:00
Andriy Dzikh 9d41adbf06 Create page for viewing all tests for an environment. 2021-06-25 09:39:11 -07:00
Andriy Dzikh fc6c4eb04e Move existing formatting/charting code into its own function. 2021-06-25 09:29:54 -07:00
Andriy Dzikh f404d5976f Refactor flake chart data processing to simplify into two steps: aggregation and formatting. 2021-06-25 09:26:57 -07:00
Ilya Zuyev 0033bf7ed3 make targets for deb and rpm 2021-06-24 20:02:21 -07:00
Andriy Dzikh a0c5634dfd Make nicer fonts for test tooltips in flake charts. 2021-06-24 11:57:07 -07:00
Andriy Dzikh 1c7d6b719c Add links to hashes in flake charts. 2021-06-24 11:51:00 -07:00
Andriy Dzikh 0ff73cf645 Group commit hashes into one entry rather than one entry per run. 2021-06-24 11:42:50 -07:00
Steven Powell e3326f88df finishing last of comments 2021-06-23 15:03:03 -07:00
Steven Powell 0a5aadf502 addressed more comments 2021-06-23 10:42:39 -07:00
Steven Powell 39208c56c4 addressed some of the comments 2021-06-23 09:38:59 -07:00
Andriy Dzikh fbf61e3e33 Fix running a non-existent command in upload_integration_report. 2021-06-22 14:55:49 -07:00
Sharif Elgamal 055e20c28d fix generate-docs bugs part 2 2021-06-22 12:58:38 -07:00
Sharif Elgamal 269514601b better title for PR 2021-06-22 12:27:14 -07:00
Sharif Elgamal 74635e495a more fixes :) 2021-06-22 10:47:44 -07:00
Sharif Elgamal 23a31d7365 fix generate_docs bugs 2021-06-21 15:35:59 -07:00
Sharif Elgamal 811ff18161
Merge pull request #11677 from sharifelgamal/auto-gen-docs
Automatically run `make generate-docs` after every PR merge
2021-06-18 14:30:08 -07:00
minikube-bot c8fb43220d remove exit on error 2021-06-18 13:56:02 -07:00
Sharif Elgamal 248942f830 move around check 2021-06-18 13:46:30 -07:00
Sharif Elgamal 1200975bc7 debug 2021-06-18 13:28:01 -07:00
Medya Ghazizadeh 5501afa9ef
Merge pull request #11683 from andriyDev/FixNoFlakesComment
Fix flake rates being commented about when no failed tests are present.
2021-06-17 17:58:44 -04:00
Sharif Elgamal 5816b2a0c7 golang 1.6.4 2021-06-17 13:51:37 -07:00
Sharif Elgamal f8b2ebcc63 do not run workflow if there is no secret 2021-06-17 13:25:13 -07:00
Sharif Elgamal d37a3e0ba2 make script executable 2021-06-17 12:41:37 -07:00
Sharif Elgamal c1a7937184 change workflow condition 2021-06-17 12:08:50 -07:00
Medya Ghazizadeh 7d9bcf8626
Merge pull request #11684 from andriyDev/ChangeFlakeColors
Update flake chart colors
2021-06-17 13:00:46 -04:00
Medya Ghazizadeh 3c01c8a152
Merge pull request #11675 from andriyDev/FixReportFlakes
Stop using sudo for check_install_gh
2021-06-17 13:00:04 -04:00
Andriy Dzikh 300230bd5c Update flake chart colors. 2021-06-17 09:41:40 -07:00
Andriy Dzikh 5b8b5ce102 Fix flake rates being commented about when no failed tests are present. 2021-06-17 09:28:27 -07:00
Andriy Dzikh 9f601ea393 Fix commenting to a PR instead of an issue. 2021-06-16 18:03:52 -07:00
Sharif Elgamal c91e981e5f Merge branch 'master' of github.com:kubernetes/minikube into auto-gen-docs 2021-06-16 16:30:01 -07:00
Andriy Dzikh c037e5f62f Stop using sudo for check_install_gh. 2021-06-16 15:29:50 -07:00
Steven Powell 8f019e0418
Merge pull request #11659 from spowelljr/updateTimeToK8s
Create automated time-to-k8s benchmarks on release
2021-06-16 20:04:11 +00:00
Sharif Elgamal 7b5381b697 add generate-docs script 2021-06-16 09:23:54 -07:00
Steven Powell 25c5bec652 change back iterations to 5 2021-06-15 10:30:08 -07:00
Steven Powell 599e7c49e9 create automated time-to-k8s benchmarks on release 2021-06-15 10:17:46 -07:00
Andriy Dzikh 231fbee7b5 Fix collect_data_manual not being formatted correctly. 2021-06-15 09:55:32 -07:00
Medya Ghazizadeh 6a9076391d
Merge pull request #11602 from andriyDev/Flakes
Create a system for generating public flake rate reporting.
2021-06-15 12:51:29 -04:00
Sharif Elgamal 76d74191d8
Merge pull request #11623 from sharifelgamal/1.21.0
Bump Makefile for 1.21.0 release
2021-06-11 08:46:19 -07:00
Andriy Dzikh 1c1fdbff42 Make compute_flake_rate also compute average test duration. 2021-06-10 14:00:47 -07:00
Andriy Dzikh 728229c719 Add more environments to the allowed environments for commenting. 2021-06-10 13:36:23 -07:00
Andriy Dzikh dc6cb0b671 Rename collect_data.sh to collect_data_manual.sh and make header comment more clear. 2021-06-10 13:30:35 -07:00
Andriy Dzikh 884216db9e Make report_flakes.sh abort if there are no failed tests. 2021-06-10 13:27:00 -07:00
Andriy Dzikh 7e785c1c1e Make collect_data.sh optimzie and upload to GCS automatically. 2021-06-10 13:19:05 -07:00
Andriy Dzikh a98db3511e Add description and example usage to all shell scripts. 2021-06-10 13:16:16 -07:00
Andriy Dzikh 2b3f7cedd7 Remove bootstrap from flake_chart.html. 2021-06-10 13:02:56 -07:00
Sharif Elgamal 79e1b4e99d Bump Makefile for 1.21.0 release 2021-06-10 11:34:06 -07:00
Andriy Dzikh ecaee4d932 Add better comments for optimize_data and process_data. 2021-06-10 11:16:44 -07:00
Andriy Dzikh 79f8de1bcb Add comment for testEntry. 2021-06-10 11:11:34 -07:00
Andriy Dzikh e9e7b85e02 Make types and functions private. 2021-06-10 11:08:44 -07:00
Steven Powell cc89907cca add -Force to folder rm 2021-06-10 10:40:49 -07:00
Andriy Dzikh e089973f65 Create SplitEntryMap type to simplify some definitions. 2021-06-09 15:21:43 -07:00
Steven Powell 3b27578610 delete `minikube-integration` folder in case last test failed to delete it 2021-06-09 15:11:03 -07:00
Andriy Dzikh fb8e4d982b Clean up compute_flake_rate.go. 2021-06-08 13:06:28 -07:00
Andriy Dzikh fcbae7eaa1 Make sure gh is present when running report_flakes.sh. 2021-06-08 11:54:08 -07:00
Andriy Dzikh 3aa922813c Fix wrong number of parameters for report_flakes.sh. 2021-06-08 11:50:14 -07:00
Andriy Dzikh 716f690189 Change copyright to 2021. 2021-06-07 16:39:06 -07:00
Andriy Dzikh 139d7e3771 Fix lints in compute_flake_rate.go and compute_flake_rate_test.go. 2021-06-07 16:36:01 -07:00
Andriy Dzikh 8f953781a2 Create report_flakes script to comment on PRs about flake rates of failed tests. 2021-06-07 14:44:49 -07:00
Andriy Dzikh 7c46154600 Rename jenkins_upload_tests.sh to upload_tests.sh.
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
2021-06-07 14:12:31 -07:00
Andriy Dzikh 501b238841 Use "set -eu -o pipefail" for all scripts.
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
2021-06-07 14:09:32 -07:00
Andriy Dzikh 9e7f1ebbf0 Make computing flake rates print out percentages (with fixed 2 decimal precision) rather than floats. 2021-06-07 13:49:40 -07:00
Andriy Dzikh a80f3bc5ae Add license to upload_tests script. 2021-06-07 13:49:05 -07:00
Steven Powell b39f171268 ensure Windows integration tests are ephemeral 2021-06-04 14:08:37 -07:00
Andriy Dzikh cec82877d8 Format flake rates into CSV containing environment, test, and flake rate. 2021-06-03 14:25:04 -07:00
Andriy Dzikh d245cfcdf7 Move all flake rate files to Jenkins to allow auto-upload. 2021-06-03 14:12:03 -07:00
Andriy Dzikh 40fdbe61ae Allow Jenkins to append to the flake rate data. 2021-06-03 14:01:06 -07:00
Andriy Dzikh d7d3593a89 Rewrite process_data.sh to no longer depend on git log.
This now means we depend on the date being contained within the details.
2021-06-03 13:38:44 -07:00
Medya Gh 74fe0e9f62 bump gopogh 2021-06-02 16:30:50 -07:00
Andriy Dzikh 65be305aab Add test for ComputeFlakeRates. 2021-06-02 16:17:39 -07:00
Andriy Dzikh df6f7a8485 Add test for FilterRecentEntries. 2021-06-02 15:48:12 -07:00
Andriy Dzikh 4e9718a28b Add test for SplitData. 2021-06-02 14:15:25 -07:00
Andriy Dzikh 401bcbfe0a Move comparison code to its own function. 2021-06-02 14:12:43 -07:00
Andriy Dzikh 9d4153f0ab Create test for ReadData. 2021-06-02 14:00:01 -07:00
Andriy Dzikh 60929009d6 Create FilterRecentEntries to only include the last N run dates. 2021-06-02 11:01:33 -07:00
Andriy Dzikh e6a553f679 Compute flake rate of all entries split by environment and test. 2021-06-02 11:00:40 -07:00
Andriy Dzikh de6cff23db Split entries based on environment and test name. 2021-06-02 11:00:40 -07:00
Andriy Dzikh ef33b8661c Create new compute_flake_rate.go with basic CSV parsing. 2021-06-02 11:00:38 -07:00
Andriy Dzikh fbf4e03eb9 Add license to sh scripts. 2021-06-01 14:06:54 -07:00
Andriy Dzikh 78e9838283 Refactor collect_data into collect_data + process_data.
This allows processing data coming from other sources.
2021-06-01 14:02:06 -07:00
Andriy Dzikh 419f2506e6 Add "data optimization" which treats empty fields in data.csv as equivalent to the previous entry.
This optimization takes data size down from 41 MB to 16MB which is ~40% which is huge!
2021-06-01 12:15:16 -07:00
Andriy Dzikh 424c954770 Add duration to existing graph with appropriate labels. 2021-06-01 11:33:22 -07:00
Andriy Dzikh b55c6726ef Use URL search query to select test and environment. 2021-06-01 10:18:26 -07:00
Andriy Dzikh ae62edbd18 Update JS to accept duration data. 2021-06-01 10:17:29 -07:00
Andriy Dzikh b5151a6d89 Add duration to data collection. 2021-06-01 09:46:14 -07:00
Andriy Dzikh f9f3ef9a09 Pass driverName into Preload and PreloadExists to report no preload for BareMetal. 2021-05-27 15:02:00 -07:00
Steven Powell ee5faa6fc4
Merge branch 'master' into automateTimeToK8s 2021-05-26 16:45:13 -07:00
Steven Powell 913d096d03 add note to release notes to remind to run `make time-to-k8s-benchmark` 2021-05-26 16:44:21 -07:00
Steven Powell 766cfd1e76 add copyright boilerplate 2021-05-26 16:26:45 -07:00
Steven Powell c30dbb0ead clean up var init 2021-05-26 15:59:50 -07:00
Steven Powell 2530048689 removed unused consts 2021-05-26 15:50:36 -07:00
Steven Powell a81761ea4a add make command to auto benchmark time-to-k8s and update website 2021-05-26 15:45:11 -07:00
Andriy Dzikh 2e5ea59774 Refactor data cleaning. 2021-05-26 09:36:44 -07:00
Andriy Dzikh 328d54ef63 Create first flake rate chart. 2021-05-25 16:20:56 -07:00
Andriy Dzikh b45b4c9a0b Include Google Charts. Refactor to wait for Google Charts and test data loading at the same time. 2021-05-25 13:42:53 -07:00
Andriy Dzikh b33e272435 Create basic parsing of CSV test data. 2021-05-25 13:42:12 -07:00
Andriy Dzikh abdbfa63b6 Create initial HTML and JS for flake rate site. 2021-05-25 11:40:08 -07:00
Andriy Dzikh 79c2a51f65 Change update leaderboard message to use make target instead of shell script. 2021-05-24 09:53:46 -07:00
Andriy Dzikh 63f0f8774b Create script to collect log data. 2021-05-24 09:28:11 -07:00
Andriy Dzikh 0fe0c11c56 Add message to view contributions leaderboard to release_notes.sh. 2021-05-21 16:28:25 -07:00
Medya Ghazizadeh db2e02c94f
Merge pull request #11448 from sharifelgamal/macos-docker
ci: Add script to make sure docker is running for macos integration tests
2021-05-21 13:26:34 -07:00
Medya Ghazizadeh 5e101c7605
Merge pull request #11467 from andriyDev/PublishPullsheetLeaderboard
Publish pullsheet leaderboard to website
2021-05-21 11:25:57 -07:00
Medya Ghazizadeh b76766d079
Merge pull request #11447 from ilya-zuyev/ilyaz/gh_actions_cleanup
add GitHub Actions cleanup scripts
2021-05-21 09:18:04 -07:00
Sharif Elgamal 40fd08e5fa adding check if docker is already running 2021-05-20 15:31:31 -07:00
Andriy Dzikh 0913c02127 Fix update_contributions not working correctly on Mac (Mac sed does not have execute command). 2021-05-20 11:54:04 -07:00
Andriy Dzikh c04f2d731f Add message to hack/release_notes.sh to tell maintainers to update contributions. 2021-05-20 09:44:12 -07:00
Andriy Dzikh 117e1495fa Create script to update contributions page. 2021-05-20 09:25:26 -07:00
Sharif Elgamal 2620012bed simplify code a bit 2021-05-19 15:00:30 -07:00
Ilya Zuyev e6dc7243f3 add comments 2021-05-19 14:53:04 -07:00
Sharif Elgamal a4c7e5b6dc fix permissions 2021-05-19 09:45:04 -07:00
Ilya Zuyev b78415fcd0 add logs 2021-05-18 22:04:25 -07:00
Ilya Zuyev 443c0c00a1 add logs 2021-05-18 22:03:57 -07:00
Ilya Zuyev 6da92d44f6 Fix golang installation script for arm64 platform 2021-05-18 22:00:57 -07:00
Ilya Zuyev 39f7db8783 check if cron rule is already installed 2021-05-18 19:18:45 -07:00
Ilya Zuyev 8f213df9a7 update workflow 2021-05-18 17:27:45 -07:00
Ilya Zuyev 246a2e55d5 fix boilerplate 2021-05-18 17:21:08 -07:00
Ilya Zuyev c2f8e17d2f fix boilerplate 2021-05-18 17:05:03 -07:00
Sharif Elgamal f319ac784c Add script to make sure docker is running for macos integration tests 2021-05-18 16:54:09 -07:00
Ilya Zuyev 4ab318e604 add GitHub Actions cleanup scripts 2021-05-18 16:12:04 -07:00
Predrag Rogic f425739254
prevent kube-proxy trying to change nf_conntrack_max 2021-05-15 19:36:49 +01:00
Sharif Elgamal c68216acd8
Merge pull request #11402 from sharifelgamal/storage-prov
add script to automatically release storage provisioner
2021-05-14 12:25:38 -07:00
Sharif Elgamal 468e2e85bb git username 2021-05-13 10:43:55 -07:00
Sharif Elgamal ad4716813a fix if statements 2021-05-13 10:16:04 -07:00
Sharif Elgamal 98e7cbf4d3 perms 2021-05-13 10:12:12 -07:00
Sharif Elgamal 3a2bad6d28 don't automatically bump version 2021-05-13 09:51:31 -07:00
Sharif Elgamal 3042313322 don't fail on docker error 2021-05-13 09:42:51 -07:00
Sharif Elgamal edd1230767 add script to automatically release storage provisioner 2021-05-13 09:40:55 -07:00
Andriy Dzikh 48b7dea2b5 Add flags to pullsheet to prevent Info and Warning logs in stderr. 2021-05-13 09:12:47 -07:00
Medya Ghazizadeh 0b58021952
Merge pull request #11377 from andriyDev/FixReleaseNotesOnMac
Refactor hack/release_notes.sh pullsheet commands and use sort instead of awk sorting
2021-05-12 13:00:02 -07:00
Medya Ghazizadeh 9e57c747e2
Merge pull request #11351 from afbjorklund/go-1.16.4
Upgrade go version from 1.16.1 to 1.16.4
2021-05-11 14:53:49 -07:00
Medya Ghazizadeh c136fe3cfd
Merge pull request #11060 from afbjorklund/retro-arch
Allow building minikube for outdated architectures
2021-05-11 12:22:03 -07:00
Andriy Dzikh 02b9fd7d7e Refactor hack/release_notes.sh pullsheet commands and use sort instead of awk sorting. 2021-05-11 11:41:48 -07:00
Anders F Björklund 118d201a73 Upgrade go version from 1.16.1 to 1.16.4 2021-05-10 07:16:24 +02:00
Anders F Björklund ac624bff80 Add missing arm64 tarballs to the release page
The arm64 build targets for the drivers are currently missing,
but they should be downloaded at runtime anyway so exclude them.
2021-05-09 10:11:22 +02:00
Sharif Elgamal fea1be9d51 unify integration test names for uploading 2021-05-07 15:35:38 -07:00
Sharif Elgamal 603e49189e allow install docker to fail 2021-05-07 10:07:08 -07:00
Sharif Elgamal 290230831e break OS_ARCH into OS and ARCH 2021-05-06 16:23:41 -07:00
Sharif Elgamal 73291c04c7 make common executable 2021-05-06 13:06:12 -07:00
Sharif Elgamal ad885687de actually common.sh is a better choice 2021-05-06 13:05:02 -07:00
Sharif Elgamal 63b773e88b combine run_tests.sh and common.sh for integration testing 2021-05-06 12:43:16 -07:00
Sharif Elgamal be24532339 fix other API instances of access token for tests 2021-05-05 15:53:36 -07:00
Sharif Elgamal 90d148faa7 change authentication for jenkins job 2021-05-05 14:15:33 -07:00
Sharif Elgamal 4184a9d02d
Merge pull request #10927 from sharifelgamal/macstadium
ci: Re-enable integration testing for macOS
2021-05-04 17:58:14 -07:00
Andriy Dzikh f7e5b6b422 Add a link in hack/release_notes.sh to the changelog for more details. 2021-05-04 16:16:56 -07:00
Andriy Dzikh 13b3aae355 Thank issue-commenters in hack/release_notes.sh. 2021-05-04 15:01:17 -07:00
Andriy Dzikh 83dc6be81c Thank PR reviewers in hack/release_notes.sh. 2021-05-04 14:56:38 -07:00
Steven Powell 2be9109797 fixed CPU benchmarking typos and small formatting 2021-05-04 12:48:04 -07:00
Sharif Elgamal cdb0de091a full suite for docker 2021-05-04 12:16:13 -07:00
Sharif Elgamal debca7805e i just wanna see if it works ok 2021-05-04 11:07:36 -07:00
Sharif Elgamal 7a4855df80 take 2 2021-05-04 10:42:09 -07:00
Sharif Elgamal 3daad34d4e fix up loop 2021-05-04 10:01:52 -07:00
Sharif Elgamal 384cb73b35 add ability for custom file name for uploading files 2021-05-03 17:53:39 -07:00
Sharif Elgamal 4f381cc1e6 Merge branch 'master' of github.com:kubernetes/minikube into macstadium 2021-05-03 17:30:20 -07:00
Sharif Elgamal 4186087e64
Revert "Run test2json during the test and not afterwards" 2021-05-03 17:23:24 -07:00
Sharif Elgamal c14051eb35 add pidof to macos machines 2021-05-03 16:43:01 -07:00
Sharif Elgamal a08f44b746 make hyperkit tests full suite 2021-05-03 15:45:47 -07:00
Sharif Elgamal b090f4901c make sure timeout is installed on macos 2021-05-03 13:27:11 -07:00
Sharif Elgamal 17d677dfc9 small changes 2021-05-03 13:21:56 -07:00
Anders F Björklund b4379c326f Run test2json during the test and not afterwards
Running it after the test is completed, means that the timestamps
of the output will be wrong (not reflecting the actual test run).

This should use "go test -json" instead of the "test2json" pipe,
but need something like "gotestsum" to show both out and json...
2021-05-03 08:08:14 +02:00
Steven Powell 82e9a5248a fixed gsutil copy from releases-beta.json 2021-04-30 17:22:21 -07:00
Sharif Elgamal 7cce80e555 trying hyperkit?? 2021-04-30 11:24:27 -07:00
Sharif Elgamal bb9fa3d120 hey, uh, don't kill docker please 2021-04-30 10:44:09 -07:00
Sharif Elgamal d9d251ac38 use external upload script 2021-04-30 08:20:24 -07:00
Sharif Elgamal f26b2df8c3 install pstree on macos as well 2021-04-29 16:36:00 -07:00
Sharif Elgamal eb3f2b7516 Merge branch 'master' of github.com:kubernetes/minikube into macstadium 2021-04-29 16:16:20 -07:00
Medya Ghazizadeh fe0a1774a6
Merge pull request #11140 from govargo/add-cpu-benchmark
Add cpu usage benchmark command `make cpu-benchmark` and website docs
2021-04-29 15:16:01 -07:00
Kenta Iso 43b1dfd433 Change barChart color and add benchmark description to docs of benchmark 2021-04-30 06:41:44 +09:00
Medya Ghazizadeh ac2b98d744
Merge pull request #11169 from spowelljr/addBetaNotifications
Add opt-in notifications for beta releases
2021-04-29 14:03:59 -07:00
Kent Iso e3fd45d079 Update linux auto-pause result with improved method 2021-04-29 20:05:59 +00:00
Kent Iso 6f0391738c Improve verify auto pause step and Update README.md for auto-pause benchmark 2021-04-29 19:56:06 +00:00
Sharif Elgamal 77dd7a7cd6 Merge branch 'master' of github.com:kubernetes/minikube into macstadium 2021-04-28 18:56:24 -07:00
Sharif Elgamal a3b52560cd that was a bad idea 2021-04-28 18:49:24 -07:00
Sharif Elgamal 7ed18e5811 try to propagate sudo creds 2021-04-28 18:21:24 -07:00
Kenta Iso ad7b7fa584 Add verify step for control plane Paused status for cpu benchmark 2021-04-29 05:02:41 +09:00
Kent Iso a981e81f9c Update README about cpu-benchmark 2021-04-29 01:06:27 +09:00
Kent Iso 67da2c88ce Fix lint error 2021-04-29 01:06:27 +09:00
Kent Iso 52ddca0ea4 divide idle only benchmark and autopause benchmark of cpu usage 2021-04-29 01:06:27 +09:00
Kent Iso a6fdc2f8ea Add data label to bar chart 2021-04-29 01:06:26 +09:00
Kent Iso 288eb00810 Add linux cpu benchmark image 2021-04-29 01:06:26 +09:00
Kent Iso 7fe94b5876 Add minikube docker with auto-pause to cpu benchmark 2021-04-29 01:06:26 +09:00
Kent Iso 45a867d3b8 Add cpu usage benchmark 2021-04-29 01:06:26 +09:00
Steven Powell 285457ebda updated releases script to updates releases-beta.json 2021-04-27 13:34:08 -07:00
Sharif Elgamal 0ed1c923a9 Make sure to capture errors in auto kicbase builds 2021-04-26 17:54:07 -07:00
Predrag Rogic 79ba91cd44
fix flake integration tests: cleanups and timeouts 2021-04-23 22:19:59 +01:00
Medya Ghazizadeh 6f97066217
Merge pull request #11095 from ilya-zuyev/ilyaz/preloads_jenkins_job
Move preload generation to Jenkins
2021-04-23 13:25:18 -07:00
Ilya Zuyev 71ba8c19bb add comments 2021-04-20 11:44:29 -07:00
Medya Ghazizadeh 6ad8cd7d22
Merge pull request #11030 from prezha/fix-insufficient-memory
fix insufficient memory issues
2021-04-20 09:52:30 -07:00
Medya Gh 1207de734b bump golang lint ci to latest 2021-04-19 15:16:31 -07:00
Anders F Björklund 9fded7695f Add retro binaries to the all target and release 2021-04-18 13:10:50 +02:00
Ilya Zuyev 739424c5ac reorder k8s versions to process 2021-04-16 13:00:41 -07:00
Ilya Zuyev bf5d87423a fix comments 2021-04-16 10:52:16 -07:00
Ilya Zuyev e0c3ef3f51 improve logs 2021-04-16 10:41:07 -07:00
Ilya Zuyev 9af84a7d95 debug options 2021-04-15 10:40:43 -07:00
Ilya Zuyev 74c1029d9f more logs 2021-04-14 14:01:41 -07:00
Ilya Zuyev ce748474fb more logs 2021-04-14 13:59:42 -07:00
Ilya Zuyev 06c4bf030f goimports 2021-04-13 13:24:57 -07:00
Ilya Zuyev 71080b0860 add command line options to preload-generator 2021-04-13 12:18:44 -07:00