Commit Graph

1295 Commits (master)

Author SHA1 Message Date
Steven Powell c7ef1a7e6c more .sh files without exec permission 2022-05-12 10:11:22 -07:00
Steven Powell 68731bf7c6 move cron install to installers dir 2022-05-12 10:10:07 -07:00
Steven Powell 3e0cd168b5 add cron to cleanup go modules 2022-05-11 16:32:02 -07:00
Sharif Elgamal d1829f24ec small fixes 2022-05-06 14:52:37 -07:00
Sharif Elgamal 5b2dfe60b3 Merge branch 'master' of github.com:kubernetes/minikube into iso-arm64 2022-05-06 13:36:50 -07:00
Sharif Elgamal 9f1bf48849 move iso CHANGELOG logic around 2022-05-05 11:25:54 -07:00
klaases 9176b9e84e
Update hack/jenkins/preload_generation.sh
Perfect, thanks!

Co-authored-by: Steven Powell <44844360+spowelljr@users.noreply.github.com>
2022-05-04 14:39:31 -07:00
klaases 3f06512ac8 Remove extra line 2022-05-04 14:33:37 -07:00
klaases af8777a171 Add cleanup and reboot to preload generation 2022-05-04 14:32:29 -07:00
Sharif Elgamal 360c3aa971 Merge branch 'master' of github.com:kubernetes/minikube into iso-arm64 2022-04-29 14:11:16 -07:00
Sean Wei d85321009b Fix GitHub word for Jenkins scripts 2022-04-25 15:54:40 +08:00
Sharif Elgamal 1c31b6cb81 typo 2022-04-21 19:13:22 -07:00
Sharif Elgamal ed2aa0333f Merge branch 'master' of github.com:kubernetes/minikube into iso-arm64 2022-04-18 12:40:22 -07:00
minikube-bot 6b7d4dda49 bump golang versions 2022-04-18 09:02:21 +00:00
Sharif Elgamal f6c2f5bb79 Merge branch 'master' of github.com:kubernetes/minikube into iso-arm64 2022-04-11 14:25:53 -07:00
Steven Powell 03b5bb7bef
Merge pull request #13864 from minikube-bot/auto_bump_golang_version
bump golang version
2022-03-30 16:12:10 -07:00
Steven Powell 9105b1479d pr-flake-rate: default links to last 90 days 2022-03-30 14:49:01 -07:00
Steven Powell 38827bec66 have test table link to matching time period 2022-03-30 10:30:52 -07:00
Sharif Elgamal eb14277c3d Merge branch 'master' of github.com:kubernetes/minikube into iso-arm64 2022-03-28 16:21:05 -07:00
Sharif Elgamal c253eb5183 fix up makefile for aarch64 iso 2022-03-28 16:20:30 -07:00
minikube-bot b8ba447784 bump golang versions 2022-03-28 09:02:23 +00:00
Sharif Elgamal c89495934f report cloud shell failures back to github 2022-03-21 13:44:13 -07:00
Sharif Elgamal 033f0300f9 switch it to kvm linux crio 2022-02-25 13:40:43 -08:00
Sharif Elgamal 279cf2d39f Ignore arm64 flake test results for now 2022-02-25 13:24:51 -08:00
minikube-bot 3a006d7dc7 bump golang versions 2022-02-14 09:02:23 +00:00
Steven Powell 1b10eb02d9 updated release script to push v2 releases files 2022-02-02 12:31:07 -08:00
Steven Powell 6c72f9378b support legacy releases.json file 2022-02-01 17:11:33 -08:00
minikube-bot e9f7972701 bump golang versions 2022-01-24 23:46:12 +00:00
Steven Powell ea01e98135 return non-zero exit code on improper flag usage 2022-01-06 14:53:19 -08:00
Steven Powell 2aef5c60ee trim off new line character 2022-01-06 14:12:08 -08:00
Steven Powell 7eac7a5448 add boilerplate 2022-01-06 14:06:43 -08:00
Steven Powell 81a3f1ac27 remove testing code 2022-01-06 14:05:28 -08:00
Steven Powell 2b54b45765 add SHA for all archs to releases.json file 2022-01-06 14:01:29 -08:00
Steven Powell 3acd6d6fef
Merge pull request #13263 from spowelljr/make30Day
flake charts: allow toggling between all-time and last 90 day flake charts
2022-01-05 09:31:13 -08:00
Steven Powell 186e42a052 add comment to explain link generation 2022-01-04 14:54:37 -08:00
Steven Powell c7d8220056 fixed lint errors 2022-01-04 10:37:15 -08:00
Steven Powell 6adc8ed1cb move files to not have duplicate main funcs 2021-12-30 12:19:20 -08:00
Steven Powell 29293577e5 remove unused arg 2021-12-29 17:20:26 -08:00
Steven Powell 96802bd02e allow toggling between all-time and last 90 day flake charts 2021-12-29 17:16:28 -08:00
Sharif Elgamal 840ad7fadc copy existing ISO for faster ISO release 2021-12-22 14:25:50 -08:00
Steven Powell e43ead0043 add quote to Windows env 2021-12-16 10:02:59 -08:00
Steven Powell b17834c96b added env to suppress Docker performance messages 2021-12-14 13:46:52 -08:00
minikube-bot 4f1944f026 bump golang versions 2021-12-13 23:22:50 +00:00
Steven Powell c948fc4519
Revert "bump golang version to 1.17.5" 2021-12-13 10:42:47 -08:00
minikube-bot 1bd034917a bump golang versions 2021-12-13 09:06:54 +00:00
Steven Powell a91d28325c leave existing Docker Desktop instance running 2021-12-03 11:51:46 -08:00
Medya Ghazizadeh 12b9d920c8
Merge pull request #12909 from sharifelgamal/macos
start including macOS tests in flake reports
2021-11-09 13:35:55 -08:00
Sharif Elgamal 93ac75f782
Merge pull request #12893 from sharifelgamal/latest-bin
only copy binaries to minikube/latest on non-PR builds
2021-11-09 12:37:21 -08:00
Sharif Elgamal f64c019633 change chowns in golang install script to selgamal 2021-11-09 11:36:13 -08:00
Sharif Elgamal 69fb310f57 start including macOS tests in flake reports 2021-11-09 10:09:39 -08:00
Steven Powell 13993d565d fix running `minikube delete` before `MINIKUBE_HOME` set 2021-11-09 07:54:09 -05:00
Sharif Elgamal dae454ecd8 fix unbound var error part 3 2021-11-08 15:20:14 -08:00
Sharif Elgamal 390dff5fed fix unbound var error part 2 2021-11-08 14:49:52 -08:00
Sharif Elgamal 3cb1f322a5 fix unbound var error 2021-11-08 14:18:37 -08:00
Sharif Elgamal 4cfe4afdc3 Merge branch 'latest-bin' of github.com:sharifelgamal/minikube into latest-bin 2021-11-08 13:06:25 -08:00
Sharif Elgamal c7a208daef be more specific about what gets copied to the mirror 2021-11-08 13:06:00 -08:00
Sharif Elgamal 1517f73ae0
Update hack/jenkins/minikube_cross_build_and_upload.sh
Co-authored-by: Steven Powell <44844360+spowelljr@users.noreply.github.com>
2021-11-08 10:37:05 -08:00
Steven Powell 8c74e26567
Merge pull request #12770 from spowelljr/arm64Jq
Throw error if trying to install jq on arm64 machines
2021-11-08 11:21:09 -07:00
Sharif Elgamal 4d1d0e0cde only copy binaries to minikube/latest on non-PR builds 2021-11-08 08:35:57 -08:00
Sharif Elgamal 41a3a99f87
Merge pull request #12873 from sharifelgamal/time-to-k8s
Various CI Script Improvements
2021-11-08 08:17:08 -08:00
Steven Powell f8a0c53415 update exit message 2021-11-08 08:58:28 -05:00
Steven Powell a565ec05e5 add install case for linux arm64 2021-11-08 08:56:48 -05:00
minikube-bot bc7ee0e00c bump golang versions 2021-11-08 09:02:26 +00:00
Sharif Elgamal bc93814168 remove extra script and just use alternate spot as a mirror 2021-11-04 14:01:33 -07:00
Sharif Elgamal 21a66f038c ci script stuffs 2021-11-04 12:47:49 -07:00
Sharif Elgamal 3a90d58d8f propagate ROOT_JOB_ID into cloud shell tests for proper log storage 2021-11-02 13:36:21 -07:00
Sharif Elgamal da2507d151 set env vars correctly so go install works 2021-10-26 15:06:54 -07:00
Sharif Elgamal 31eff422b3 retag latest kicbase for release instead of rebuilding it 2021-10-26 14:30:01 -07:00
Steven Powell 82bd665abb error if trying to install jq on arm64 machines 2021-10-25 10:25:40 -07:00
Sharif Elgamal 9b28e2330d don't let root own the go installation folder on CI machines 2021-10-21 14:31:28 -07:00
Steven Powell b6e8a3be1b directly code golang version 2021-10-20 16:29:58 -07:00
Sharif Elgamal 55f5c2fab7 disable the cleanup cron for now 2021-10-18 13:51:41 -07:00
Sharif Elgamal 88547d8ca3 check for more than just the e2e binary for the cleanup cron 2021-10-12 14:29:58 -07:00
Sharif Elgamal de3deb727a reboot windows machines after every test 2021-10-06 13:25:09 -07:00
Sharif Elgamal 85422b0a9d actually run the cron :) 2021-10-05 11:16:58 -07:00
Sharif Elgamal 79c16ab5cb fix github context when docker fails 2021-10-05 09:25:08 -07:00
Sharif Elgamal d61c75cab1 cleanup the, uh, cleanup scripts 2021-10-05 08:55:39 -07:00
Sharif Elgamal b887c235e7 refactor common code like a good programmer 2021-10-01 16:45:03 -07:00
Sharif Elgamal 5247cfd195 typo for commit status 2021-10-01 11:25:00 -07:00
Sharif Elgamal 8b95abe7b5 one last syntax issue 2021-09-30 16:00:31 -07:00
Sharif Elgamal c5921094c8 fix powershell syntax 2021-09-30 15:53:16 -07:00
Sharif Elgamal 268ac0e9a4 make sure docker is running no matter what 2021-09-30 15:23:48 -07:00
Sharif Elgamal 1b503098c5 fix github api call, account for not uploading directly to GCS 2021-09-30 14:59:59 -07:00
Sharif Elgamal 86a616c157 remove the mkdir from common.ps1 since that dir already needs to exist 2021-09-30 09:45:48 -07:00
Sharif Elgamal ebbc4113a7 enable hyperv ci status 2021-09-29 14:30:43 -07:00
Sharif Elgamal 28ada81a3c enable hyperv integration tests 2021-09-29 14:23:31 -07:00
Sharif Elgamal 6388a1be0e fix perms for mkcmp 2021-09-22 17:29:07 -07:00
Sharif Elgamal 5a89895154 used PR's mkcmp for perf comments 2021-09-22 23:01:31 +00:00
Sharif Elgamal 7fef2012af don't install github-release for now 2021-09-21 16:20:14 -07:00
Steven Powell 027403f1e9 change go get to go install 2021-09-17 13:10:03 -07:00
Steven Powell cb6fe0f6a6 add github-release install script 2021-09-17 12:02:17 -07:00
Steven Powell 1936a7b508
Merge pull request #12425 from spowelljr/updateCrio
Update cri-o from v1.20.0 to 1.22.0
2021-09-15 18:21:10 -07:00
Sharif Elgamal 728e97d154 install dnsutils for nslookup on linux machines 2021-09-15 09:40:32 -07:00
Steven Powell 16941e8925 make sure current go version is installed 2021-09-14 09:50:53 -07:00
Sharif Elgamal cd05ababea filter crio instead of windows 2021-09-13 16:38:35 -07:00
Sharif Elgamal 94891b4704 add windows to list 2021-09-09 13:47:50 -07:00
Sharif Elgamal 9446725acd fix bash syntax for filtering 2021-09-09 10:16:13 -07:00
Sharif Elgamal 1997995132 syntax 2021-09-08 17:19:06 -07:00
Sharif Elgamal d3d4f74d8a filter out arm64 and macOS from flake reports 2021-09-08 17:14:01 -07:00
Sharif Elgamal ff023382c4 fix regex 2021-09-02 12:33:36 -07:00
Sharif Elgamal 0b9e97648b fix go version check 2021-09-02 11:58:39 -07:00
Sharif Elgamal 9d939663a6 correct path to script 2021-09-02 11:47:27 -07:00
Sharif Elgamal f11d14de59 make sure to install the same version of golang across scripts 2021-09-02 11:22:53 -07:00
minikube-bot bf5f081a53 bump golang versions 2021-08-30 23:49:19 +00:00
Sharif Elgamal c2153fb8cc fix link to iso/kicbase logs on build failure 2021-08-24 13:42:05 -07:00
Sharif Elgamal c5246ad15e Merge branch 'master' of github.com:kubernetes/minikube into cs-start-stop 2021-08-19 16:45:10 -07:00
Andriy Dzikh 7e3d874265 Display date in a better format, since old format reported time of 0:00 am 2021-08-17 09:37:52 -07:00
Andriy Dzikh aa90cfb57f Replace Math.min with destructuring with custom array min. 2021-08-16 16:19:47 -07:00
Sharif Elgamal 2a1693655a add space for aesthetics 2021-08-13 12:30:24 -07:00
Medya Ghazizadeh 5360e1296a
Merge pull request #12239 from spowelljr/removeVolumes
Add `--volumes` to `docker system prune`
2021-08-12 12:45:37 -07:00
Andriy Dzikh aae6390004 Add link directly to test log for gopogh link. 2021-08-12 10:05:43 -07:00
Steven Powell e88344977e add `--volumes` to `docker system prune` 2021-08-11 15:05:35 -07:00
Sharif Elgamal 72c5ee1e32 widen it to all start stop tests 2021-08-11 12:49:48 -07:00
Sharif Elgamal 2646b49a19 add TestStartStop to Cloud Shell tests 2021-08-11 11:15:51 -07:00
Andriy Dzikh 146f1dd3eb Add link to flake charts in auto-created issues 2021-08-10 13:50:34 -07:00
Sharif Elgamal 59a2929394
Merge pull request #12176 from andriyDev/ChangeDateRange
Change date range to be relative to the current day
2021-08-10 13:09:41 -07:00
Andriy Dzikh 4efd9514c5 Add priority/backlog label to all newly created issues. 2021-08-10 11:22:51 -07:00
Andriy Dzikh 6c36bb49ab Ensure gh is installed for compute_flake_rate. 2021-08-10 10:19:17 -07:00
Medya Ghazizadeh 4f99dedbfc
Merge pull request #12154 from andriyDev/CreateIssues
Create issues automatically for flaky tests
2021-08-10 09:51:08 -07:00
Andriy Dzikh b252738824 Use gh and flake rates csv to manage issues for flake rates. 2021-08-09 17:17:04 -07:00
Sharif Elgamal 4f8b628f49 display the URL to the logs on failed kicbase/iso builds 2021-08-09 16:22:46 -07:00
Andriy Dzikh 7bdb76deb6 For missing flake rate, do not link to the charts. 2021-08-09 14:41:45 -07:00
Andriy Dzikh 7e14f87786 Add reporting for tests with no flake rates computed. 2021-08-09 14:09:09 -07:00
Andriy Dzikh 790d2f1aab Refactor report_flakes.sh to make it easier to read. 2021-08-09 14:04:20 -07:00
Andriy Dzikh 9ea203bb2a Make date range be relative to the current date rather than based on when tests ran. 2021-08-09 10:22:30 -07:00
minikube-bot f3a069b729 bump golang versions 2021-08-09 09:02:04 +00:00
Andriy Dzikh dc11031e70 Create script to handle flake rate computation Jenkins job. 2021-08-06 09:35:08 -07:00
Sharif Elgamal 923455d7ca
Merge pull request #12111 from andriyDev/SimplifyLineCode
Replace yield iterator with simple await array
2021-08-04 10:08:58 -07:00
Medya Ghazizadeh 8d20e4f49e
Merge pull request #12112 from andriyDev/DisableCaching
Manage caching of HTML/JS/data.csv for public flake rate system
2021-08-03 20:46:40 -07:00
Andriy Dzikh fbd96a4bad Add cache control to ensure data.csv is checked at least after an hour of use. 2021-08-03 15:35:10 -07:00
Andriy Dzikh 1515f668dd Prevent caching of flake_chart.js. 2021-08-03 15:35:10 -07:00
Andriy Dzikh a27500e1b5 Disable caching on HTML. 2021-08-03 15:35:10 -07:00
Andriy Dzikh 4e0478eb97 Add progress bar for parsing data. 2021-08-03 14:51:52 -07:00
Andriy Dzikh 37d7ff3eff Turn bodyByLinesIterator into getBodyLinesWithProgress.
Yielding is slow! Improves processing time from 8s to 3s.
2021-08-03 14:22:31 -07:00
Andriy Dzikh 01343b001b Simplify bodyByLinesIterator to only use splitting instead of regex. 2021-08-03 13:55:33 -07:00
Andriy Dzikh c2a4e03ad0 Add message at bottom of page saying when the data was collected. 2021-08-03 10:49:24 -07:00
minikube-bot 390c72ec61 bump golang versions 2021-07-28 23:11:44 +00:00
Medya Ghazizadeh 93b084a7fb
Merge pull request #12068 from andriyDev/VariableNameScoping
Add brackets around variable name to prevent scoping problems
2021-07-28 13:31:16 -07:00
Medya Ghazizadeh d69a98c45c
Merge pull request #12065 from andriyDev/UseJobId
Use job id for logs instead of short commit hash
2021-07-28 13:30:50 -07:00
Andriy Dzikh fd3354fad2 Add brackets around variable name to prevent scoping problems. 2021-07-28 13:22:32 -07:00
Andriy Dzikh 6b21eff101 Update flake charts to use new link setup. 2021-07-27 13:28:33 -07:00
Andriy Dzikh 2951ab9a33 Replace all links in hack/jenkins using short commit with root job id. 2021-07-27 11:35:43 -07:00
Andriy Dzikh 780b11bdae Parse report data correctly in report-flakes. 2021-07-27 10:33:52 -07:00
Andriy Dzikh 14e6012fd0 Fix compute flake rate not reading data correctly. 2021-07-27 09:28:13 -07:00
Andriy Dzikh 617d4e3bdf Use root job id to collect test count and total duration for all jobs. 2021-07-26 15:55:26 -07:00
Andriy Dzikh 6e100f1402 Parse root job and related fields in JS. 2021-07-26 15:42:58 -07:00
Andriy Dzikh 5e528689e6 Remove duration chart. 2021-07-26 11:54:41 -07:00
Andriy Dzikh ec4848686d Add fields to csv data for root job ids and related variables. 2021-07-26 10:30:13 -07:00
Andriy Dzikh c47d07612b Add safety check to data processing to prevent inheritance from previous entries. 2021-07-26 10:30:10 -07:00
Andriy Dzikh 047be99688 Add ROOT_JOB_ID to gopogh details. 2021-07-26 10:23:27 -07:00
Andriy Dzikh 5c16d26379 Add current date to common.ps1 (missing for Windows). 2021-07-26 10:23:27 -07:00
Andriy Dzikh 6c558a9586 Refactor process script to be more readable. 2021-07-26 10:18:01 -07:00
Andriy Dzikh a0facafa5e Bump gopogh version from v0.8.0 to v0.9.0. 2021-07-23 15:45:14 -07:00
Andriy Dzikh 16faa3c377 Add by-week flake rate charts. 2021-07-23 13:45:26 -07:00
Andriy Dzikh a6e5755b24 Add click to sort columns to flake rate table on env page. 2021-07-23 09:16:47 -07:00
Andriy Dzikh 58324bec35 Add links to gopogh logs for each test. 2021-07-22 15:34:25 -07:00
Andriy Dzikh 6ada9a0ebc Refactor report_flakes sed to make it more readable. 2021-07-22 15:33:33 -07:00
Andriy Dzikh 8afbf67c48 Remove extra bracket in flake rate comment. 2021-07-22 14:33:04 -07:00
Steven Powell 92b7ba0c1e
Merge pull request #11420 from ntkme/fully-qualified-image-name
Use fully qualified image name for kicbase image from docker hub
2021-07-21 18:47:42 +00:00
Medya Ghazizadeh 0918511a45
Merge pull request #11986 from andriyDev/fix-flake
Fix flake report script not commenting
2021-07-19 18:31:48 -07:00
Andriy Dzikh 6176111a5c Add link to environment pages to flake rate comments. 2021-07-19 13:40:41 -07:00
Andriy Dzikh 7ca1ce55d0 No longer use non-existent ENVIRONMENT variable. 2021-07-17 14:54:42 -07:00
Andriy Dzikh 3d29731932 ls gopogh reports first to ensure they are valid, then cat the valid ones together. 2021-07-17 10:57:18 -07:00
Andriy Dzikh f26764f17a Move gotestsum installation to common.ps1 2021-07-15 14:42:49 -07:00
Andriy Dzikh 0fe08d715d Install jq on machines when running sync_tests.sh. 2021-07-15 14:26:02 -07:00
Andriy Dzikh 031f3331e7 Fix flake report script badly formatted. 2021-07-15 10:54:43 -07:00
なつき 4040311f1e Use fully qualified image name for docker hub fallback image 2021-07-13 16:09:55 -07:00
Andriy Dzikh 636329eb13 Install gotestsum with sudo. 2021-07-13 14:17:32 -07:00
Andriy Dzikh 25e561a4f7 Create proper installer script for gotestsum. 2021-07-13 14:17:32 -07:00
Andriy Dzikh b9d6528f26 Use gotestsum for testing output and json output. 2021-07-13 14:17:30 -07:00
Sharif Elgamal ad74478c78
Merge pull request #11950 from andriyDev/WindowsCommon
Create common.ps1 to simplify Windows integration tests
2021-07-13 13:23:11 -07:00
ilya-zuyev e27dba4f40
Merge pull request #11941 from ilya-zuyev/ilyaz/fix_arm_tests
minor fixes in common.sh
2021-07-13 13:19:26 -07:00
Ilya Zuyev 92604a3c00 simplify check_install_golang.sh invocation 2021-07-13 11:47:20 -07:00
Steven Powell aa92f4106c
Merge pull request #11921 from andriyDev/fix-set-pending-2
Use THE_COMMIT env var instead of ghprbActualCommit
2021-07-12 23:58:06 +00:00
Andriy Dzikh 0589a42fdf Use -eq instead of == because Powershell bad. 2021-07-12 14:10:50 -07:00
Andriy Dzikh c64ba2c080 Fix report scripts to print out only started environments, and use quotes around script names. 2021-07-12 10:10:54 -07:00
Andriy Dzikh b6e55e6c97 Create common.ps1 to simplify Windows integration tests. 2021-07-09 13:27:02 -07:00
Ilya Zuyev 579bebda1a fix script 2021-07-08 15:00:13 -07:00
Ilya Zuyev baa86c389a fix scripts 2021-07-08 13:43:10 -07:00
Steven Powell bc7995f81b update contact to Medya 2021-07-07 15:14:53 -07:00
Andriy Dzikh 3afe680c92 Use THE_COMMIT env var instead of ghprbActualCommit. 2021-07-07 13:15:33 -07:00
Andriy Dzikh 50e07ae7ec Move environment start saving up in minikube_set_pending. 2021-07-07 11:19:35 -07:00
Andriy Dzikh ae294d2067 Make sync_tests.sh remove any _integration suffix. 2021-07-07 09:21:00 -07:00
Medya Ghazizadeh 429b00d4f0
Merge pull request #11857 from ilya-zuyev/ilyaz/upload_arm64_to_gcs
fix kvm2-arm64 scripts
2021-07-02 10:10:27 -04:00
Medya Ghazizadeh a1300b1d32
Merge pull request #11874 from andriyDev/MoreCharts
More charts
2021-07-02 09:45:19 -04:00
Medya Ghazizadeh 5ecd53b1ea
Merge pull request #11794 from ilya-zuyev/ilyaz/test_report_links
Show GCS report links in integration test logs
2021-07-02 09:37:14 -04:00
Sharif Elgamal 7c45056827
Merge pull request #11851 from andriyDev/fix-flake-sync
Replace integration test "hooks" with standalone scripts
2021-07-01 16:17:54 -07:00
Andriy Dzikh 5d0eba44ec Add test count/fail count chart to environment page. 2021-07-01 16:02:22 -07:00
Andriy Dzikh a442d79877 Remove STARTED_ENVIRONMENTS from common.sh. 2021-07-01 15:53:52 -07:00
Andriy Dzikh d1b6549fbb Add duration graph to environment flake rates. 2021-07-01 14:29:19 -07:00
Ilya Zuyev 6e46d895dc Merge branch 'master' into ilyaz/test_report_links 2021-07-01 13:51:14 -07:00
Ilya Zuyev 5ccd38c0f7 fix output formatting 2021-07-01 13:47:40 -07:00
Andriy Dzikh 3904c6deab Ignore upload fail. 2021-07-01 13:32:20 -07:00
Andriy Dzikh 5dfb6726bd Make upload_tests use a remote GCS file. 2021-07-01 13:32:20 -07:00
Ilya Zuyev 3b5675d9e0 fix 2021-07-01 13:31:44 -07:00
Ilya Zuyev 2beaea9fc1 fix 2021-07-01 12:27:06 -07:00
Ilya Zuyev ea6d16db41 for PR builds: build kvm2-arm64 deb 2021-07-01 12:14:03 -07:00
Andriy Dzikh b5caf568ac Add growth column to flake list. 2021-07-01 12:01:09 -07:00
Andriy Dzikh d8ffe3f9fa Add rank column to flake rate list. 2021-07-01 11:47:40 -07:00
Andriy Dzikh a203d5f644 Replace integration test "hooks" with register_tests to fill started_environments and sync_tests to fill finished environments. 2021-07-01 11:09:34 -07:00
Steven Powell a9157c2433 improve Windows Docker clean slate 2021-06-30 16:42:09 -07:00
Medya Ghazizadeh c2f18d9d4b
Merge pull request #11841 from sharifelgamal/ugly-err
remove ugly error message from kicbase and ISO autobuild
2021-06-30 17:26:37 -04:00
Sharif Elgamal d8f8e3faf7
Merge pull request #11803 from sharifelgamal/mac-test
try less parallelization for macOS tests
2021-06-30 14:17:48 -07:00
Sharif Elgamal 06c1da3076 make URLs easier to copy 2021-06-30 14:01:14 -07:00
Medya Ghazizadeh a50406e269
Merge pull request #11767 from ilya-zuyev/ilyaz/arm64_kvm_release
Update release scripts to build arm64 version of kvm2 driver
2021-06-30 16:49:09 -04:00
Sharif Elgamal 1e7f8cbaa7 remove ugly error message from kicbase and ISO autobuild 2021-06-30 13:40:18 -07:00
Medya Ghazizadeh 323733c532
Merge pull request #11816 from andriyDev/FlakeRateSync
Report flakes only after synchronizing all integration tests
2021-06-30 16:38:08 -04:00
Andriy Dzikh 7ea94ed00a Add license and comment describing what the script does. 2021-06-29 14:51:31 -07:00
Andriy Dzikh e3883d0b56 Fix writing wrong files, and added better comments. 2021-06-29 14:47:13 -07:00
Andriy Dzikh f2c64cdb2b Add support for syncing Docker_Windows. 2021-06-29 13:32:54 -07:00
Sharif Elgamal 73e42a9a8c change parallelization in code 2021-06-29 11:46:38 -07:00
Andriy Dzikh 858aab3f55 Create sync_tests.sh to be triggered by each integration test on completion. 2021-06-29 11:44:36 -07:00
Sharif Elgamal 065929ffd0 try less parallelization for macOS tests 2021-06-29 09:22:42 -07:00
Ilya Zuyev bed20c522b In integration test logs: show GCS https links to reports 2021-06-28 14:34:05 -07:00
Andriy Dzikh 4f114dafb9 Add comment to report_flakes.sh to see environment flake charts. 2021-06-28 09:19:43 -07:00
Medya Ghazizadeh 4d078ae82f
Merge pull request #11766 from andriyDev/EnvPage
Create page with all tests for an environment in flake rate charts
2021-06-25 19:27:00 -04:00
Andriy Dzikh e9932aa7db Improve error handling to actually render in the UI. 2021-06-25 11:13:46 -07:00
Andriy Dzikh f57d7ae723 Create loading bar while downloading flake chart data. 2021-06-25 11:05:49 -07:00
Andriy Dzikh 637e8326fd Implement proper body-by-lines iterator. 2021-06-25 10:47:06 -07:00
Ilya Zuyev cb31ce2e7d remove kvm2-arm64 rpm 2021-06-25 10:08:40 -07:00
Andriy Dzikh eeaf03e4a3 Add name of test to each point in environment flake page. 2021-06-25 09:43:47 -07:00
Andriy Dzikh b1ec38f808 Add links to charts for each individual test on environment page. 2021-06-25 09:39:13 -07:00
Andriy Dzikh c067ea6cda Create table to show all flake rates for a specific environment. 2021-06-25 09:39:13 -07:00
Andriy Dzikh e22ddb9238 Compute flakeiness based on last 15 days and only chart top 10 flakiest tests. 2021-06-25 09:39:13 -07:00
Andriy Dzikh 9d41adbf06 Create page for viewing all tests for an environment. 2021-06-25 09:39:11 -07:00
Andriy Dzikh fc6c4eb04e Move existing formatting/charting code into its own function. 2021-06-25 09:29:54 -07:00
Andriy Dzikh f404d5976f Refactor flake chart data processing to simplify into two steps: aggregation and formatting. 2021-06-25 09:26:57 -07:00
Ilya Zuyev 0033bf7ed3 make targets for deb and rpm 2021-06-24 20:02:21 -07:00
Andriy Dzikh a0c5634dfd Make nicer fonts for test tooltips in flake charts. 2021-06-24 11:57:07 -07:00
Andriy Dzikh 1c7d6b719c Add links to hashes in flake charts. 2021-06-24 11:51:00 -07:00
Andriy Dzikh 0ff73cf645 Group commit hashes into one entry rather than one entry per run. 2021-06-24 11:42:50 -07:00
Andriy Dzikh fbf61e3e33 Fix running a non-existent command in upload_integration_report. 2021-06-22 14:55:49 -07:00
Medya Ghazizadeh 5501afa9ef
Merge pull request #11683 from andriyDev/FixNoFlakesComment
Fix flake rates being commented about when no failed tests are present.
2021-06-17 17:58:44 -04:00
Medya Ghazizadeh 7d9bcf8626
Merge pull request #11684 from andriyDev/ChangeFlakeColors
Update flake chart colors
2021-06-17 13:00:46 -04:00
Andriy Dzikh 300230bd5c Update flake chart colors. 2021-06-17 09:41:40 -07:00
Andriy Dzikh 5b8b5ce102 Fix flake rates being commented about when no failed tests are present. 2021-06-17 09:28:27 -07:00
Andriy Dzikh 9f601ea393 Fix commenting to a PR instead of an issue. 2021-06-16 18:03:52 -07:00
Andriy Dzikh c037e5f62f Stop using sudo for check_install_gh. 2021-06-16 15:29:50 -07:00
Andriy Dzikh 231fbee7b5 Fix collect_data_manual not being formatted correctly. 2021-06-15 09:55:32 -07:00
Medya Ghazizadeh 6a9076391d
Merge pull request #11602 from andriyDev/Flakes
Create a system for generating public flake rate reporting.
2021-06-15 12:51:29 -04:00
Andriy Dzikh 1c1fdbff42 Make compute_flake_rate also compute average test duration. 2021-06-10 14:00:47 -07:00
Andriy Dzikh 728229c719 Add more environments to the allowed environments for commenting. 2021-06-10 13:36:23 -07:00
Andriy Dzikh dc6cb0b671 Rename collect_data.sh to collect_data_manual.sh and make header comment more clear. 2021-06-10 13:30:35 -07:00
Andriy Dzikh 884216db9e Make report_flakes.sh abort if there are no failed tests. 2021-06-10 13:27:00 -07:00
Andriy Dzikh 7e785c1c1e Make collect_data.sh optimzie and upload to GCS automatically. 2021-06-10 13:19:05 -07:00
Andriy Dzikh a98db3511e Add description and example usage to all shell scripts. 2021-06-10 13:16:16 -07:00
Andriy Dzikh 2b3f7cedd7 Remove bootstrap from flake_chart.html. 2021-06-10 13:02:56 -07:00
Andriy Dzikh ecaee4d932 Add better comments for optimize_data and process_data. 2021-06-10 11:16:44 -07:00
Andriy Dzikh 79f8de1bcb Add comment for testEntry. 2021-06-10 11:11:34 -07:00
Andriy Dzikh e9e7b85e02 Make types and functions private. 2021-06-10 11:08:44 -07:00
Steven Powell cc89907cca add -Force to folder rm 2021-06-10 10:40:49 -07:00
Andriy Dzikh e089973f65 Create SplitEntryMap type to simplify some definitions. 2021-06-09 15:21:43 -07:00
Steven Powell 3b27578610 delete `minikube-integration` folder in case last test failed to delete it 2021-06-09 15:11:03 -07:00
Andriy Dzikh fb8e4d982b Clean up compute_flake_rate.go. 2021-06-08 13:06:28 -07:00
Andriy Dzikh fcbae7eaa1 Make sure gh is present when running report_flakes.sh. 2021-06-08 11:54:08 -07:00
Andriy Dzikh 3aa922813c Fix wrong number of parameters for report_flakes.sh. 2021-06-08 11:50:14 -07:00
Andriy Dzikh 716f690189 Change copyright to 2021. 2021-06-07 16:39:06 -07:00
Andriy Dzikh 139d7e3771 Fix lints in compute_flake_rate.go and compute_flake_rate_test.go. 2021-06-07 16:36:01 -07:00
Andriy Dzikh 8f953781a2 Create report_flakes script to comment on PRs about flake rates of failed tests. 2021-06-07 14:44:49 -07:00
Andriy Dzikh 7c46154600 Rename jenkins_upload_tests.sh to upload_tests.sh.
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
2021-06-07 14:12:31 -07:00
Andriy Dzikh 501b238841 Use "set -eu -o pipefail" for all scripts.
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
2021-06-07 14:09:32 -07:00
Andriy Dzikh 9e7f1ebbf0 Make computing flake rates print out percentages (with fixed 2 decimal precision) rather than floats. 2021-06-07 13:49:40 -07:00
Andriy Dzikh a80f3bc5ae Add license to upload_tests script. 2021-06-07 13:49:05 -07:00
Steven Powell b39f171268 ensure Windows integration tests are ephemeral 2021-06-04 14:08:37 -07:00
Andriy Dzikh cec82877d8 Format flake rates into CSV containing environment, test, and flake rate. 2021-06-03 14:25:04 -07:00
Andriy Dzikh d245cfcdf7 Move all flake rate files to Jenkins to allow auto-upload. 2021-06-03 14:12:03 -07:00
Andriy Dzikh 40fdbe61ae Allow Jenkins to append to the flake rate data. 2021-06-03 14:01:06 -07:00
Medya Gh 74fe0e9f62 bump gopogh 2021-06-02 16:30:50 -07:00
Medya Ghazizadeh db2e02c94f
Merge pull request #11448 from sharifelgamal/macos-docker
ci: Add script to make sure docker is running for macos integration tests
2021-05-21 13:26:34 -07:00
Sharif Elgamal 40fd08e5fa adding check if docker is already running 2021-05-20 15:31:31 -07:00
Sharif Elgamal 2620012bed simplify code a bit 2021-05-19 15:00:30 -07:00
Sharif Elgamal a4c7e5b6dc fix permissions 2021-05-19 09:45:04 -07:00
Ilya Zuyev b78415fcd0 add logs 2021-05-18 22:04:25 -07:00
Ilya Zuyev 443c0c00a1 add logs 2021-05-18 22:03:57 -07:00
Ilya Zuyev 6da92d44f6 Fix golang installation script for arm64 platform 2021-05-18 22:00:57 -07:00
Sharif Elgamal f319ac784c Add script to make sure docker is running for macos integration tests 2021-05-18 16:54:09 -07:00
Sharif Elgamal 468e2e85bb git username 2021-05-13 10:43:55 -07:00
Sharif Elgamal ad4716813a fix if statements 2021-05-13 10:16:04 -07:00
Sharif Elgamal 98e7cbf4d3 perms 2021-05-13 10:12:12 -07:00
Sharif Elgamal 3a2bad6d28 don't automatically bump version 2021-05-13 09:51:31 -07:00
Sharif Elgamal 3042313322 don't fail on docker error 2021-05-13 09:42:51 -07:00
Sharif Elgamal edd1230767 add script to automatically release storage provisioner 2021-05-13 09:40:55 -07:00
Medya Ghazizadeh 9e57c747e2
Merge pull request #11351 from afbjorklund/go-1.16.4
Upgrade go version from 1.16.1 to 1.16.4
2021-05-11 14:53:49 -07:00
Medya Ghazizadeh c136fe3cfd
Merge pull request #11060 from afbjorklund/retro-arch
Allow building minikube for outdated architectures
2021-05-11 12:22:03 -07:00
Anders F Björklund 118d201a73 Upgrade go version from 1.16.1 to 1.16.4 2021-05-10 07:16:24 +02:00
Anders F Björklund ac624bff80 Add missing arm64 tarballs to the release page
The arm64 build targets for the drivers are currently missing,
but they should be downloaded at runtime anyway so exclude them.
2021-05-09 10:11:22 +02:00
Sharif Elgamal fea1be9d51 unify integration test names for uploading 2021-05-07 15:35:38 -07:00
Sharif Elgamal 603e49189e allow install docker to fail 2021-05-07 10:07:08 -07:00
Sharif Elgamal 290230831e break OS_ARCH into OS and ARCH 2021-05-06 16:23:41 -07:00
Sharif Elgamal 73291c04c7 make common executable 2021-05-06 13:06:12 -07:00
Sharif Elgamal ad885687de actually common.sh is a better choice 2021-05-06 13:05:02 -07:00
Sharif Elgamal 63b773e88b combine run_tests.sh and common.sh for integration testing 2021-05-06 12:43:16 -07:00
Sharif Elgamal be24532339 fix other API instances of access token for tests 2021-05-05 15:53:36 -07:00
Sharif Elgamal 90d148faa7 change authentication for jenkins job 2021-05-05 14:15:33 -07:00
Sharif Elgamal cdb0de091a full suite for docker 2021-05-04 12:16:13 -07:00
Sharif Elgamal debca7805e i just wanna see if it works ok 2021-05-04 11:07:36 -07:00
Sharif Elgamal 7a4855df80 take 2 2021-05-04 10:42:09 -07:00
Sharif Elgamal 3daad34d4e fix up loop 2021-05-04 10:01:52 -07:00
Sharif Elgamal 384cb73b35 add ability for custom file name for uploading files 2021-05-03 17:53:39 -07:00
Sharif Elgamal 4f381cc1e6 Merge branch 'master' of github.com:kubernetes/minikube into macstadium 2021-05-03 17:30:20 -07:00
Sharif Elgamal 4186087e64
Revert "Run test2json during the test and not afterwards" 2021-05-03 17:23:24 -07:00
Sharif Elgamal c14051eb35 add pidof to macos machines 2021-05-03 16:43:01 -07:00
Sharif Elgamal a08f44b746 make hyperkit tests full suite 2021-05-03 15:45:47 -07:00
Sharif Elgamal b090f4901c make sure timeout is installed on macos 2021-05-03 13:27:11 -07:00
Sharif Elgamal 17d677dfc9 small changes 2021-05-03 13:21:56 -07:00
Anders F Björklund b4379c326f Run test2json during the test and not afterwards
Running it after the test is completed, means that the timestamps
of the output will be wrong (not reflecting the actual test run).

This should use "go test -json" instead of the "test2json" pipe,
but need something like "gotestsum" to show both out and json...
2021-05-03 08:08:14 +02:00
Steven Powell 82e9a5248a fixed gsutil copy from releases-beta.json 2021-04-30 17:22:21 -07:00
Sharif Elgamal 7cce80e555 trying hyperkit?? 2021-04-30 11:24:27 -07:00
Sharif Elgamal bb9fa3d120 hey, uh, don't kill docker please 2021-04-30 10:44:09 -07:00
Sharif Elgamal d9d251ac38 use external upload script 2021-04-30 08:20:24 -07:00
Sharif Elgamal f26b2df8c3 install pstree on macos as well 2021-04-29 16:36:00 -07:00
Sharif Elgamal eb3f2b7516 Merge branch 'master' of github.com:kubernetes/minikube into macstadium 2021-04-29 16:16:20 -07:00
Medya Ghazizadeh ac2b98d744
Merge pull request #11169 from spowelljr/addBetaNotifications
Add opt-in notifications for beta releases
2021-04-29 14:03:59 -07:00
Sharif Elgamal 77dd7a7cd6 Merge branch 'master' of github.com:kubernetes/minikube into macstadium 2021-04-28 18:56:24 -07:00
Sharif Elgamal a3b52560cd that was a bad idea 2021-04-28 18:49:24 -07:00
Sharif Elgamal 7ed18e5811 try to propagate sudo creds 2021-04-28 18:21:24 -07:00
Steven Powell 285457ebda updated releases script to updates releases-beta.json 2021-04-27 13:34:08 -07:00
Sharif Elgamal 0ed1c923a9 Make sure to capture errors in auto kicbase builds 2021-04-26 17:54:07 -07:00
Predrag Rogic 79ba91cd44
fix flake integration tests: cleanups and timeouts 2021-04-23 22:19:59 +01:00
Anders F Björklund 9fded7695f Add retro binaries to the all target and release 2021-04-18 13:10:50 +02:00
Sharif Elgamal 56517303ff
Merge pull request #11011 from sharifelgamal/prbot
minikube-pr-bot enhancements
2021-04-09 09:23:54 -07:00
Medya Gh 1665c7801d revert pipefail 2021-04-08 10:57:56 -07:00
Sharif Elgamal 2ce5ac0467 run minikube delete before testing 2021-04-07 15:28:12 -07:00
Sharif Elgamal dad89e8223 skip docker for now 2021-04-07 14:12:59 -07:00
Sharif Elgamal 7836e101f8 Merge branch 'master' of github.com:kubernetes/minikube into prbot 2021-04-07 14:05:07 -07:00
Sharif Elgamal 0aee73d612 skip trying to install docker in CI 2021-04-07 11:21:21 -07:00
Sharif Elgamal 400fcc1b9d use params on correct script 2021-04-07 09:54:39 -07:00
Sharif Elgamal 68b903cbb6 escapism 2021-04-07 09:04:47 -07:00
Sharif Elgamal 493f7f8edc fixes 2021-04-06 18:59:04 -07:00
Sharif Elgamal 57eb831883 fix pathing 2021-04-06 18:20:41 -07:00
Sharif Elgamal 782bdae4ed lint 2021-04-06 17:28:22 -07:00
Sharif Elgamal 84f2c86a50 minikube-pr-bot enhancements 2021-04-06 17:07:43 -07:00
Sharif Elgamal c3ae5fa8ed catch auto kicbase failures properly 2021-04-05 15:13:20 -07:00
Sharif Elgamal edd6321694 make sure to capture failures through pipes 2021-04-01 12:29:08 -07:00
Kent Iso 14cde713bd Fix unit test failing boilerplate, TestGenerateDocs 2021-04-01 21:22:05 +09:00
Medya Ghazizadeh 268c53e956
Merge pull request #10917 from spowelljr/addCloudShellTest
Added cloud shell functional tests
2021-03-30 14:57:04 -07:00
Steven Powell 197aca6e1d rename to docker_cloud_shell 2021-03-30 09:30:50 -07:00
hetong07 6db49ee5eb Update powershell script to install kubectl ver 1.20 on jenkins. 2021-03-30 09:22:48 -07:00
Steven Powell 5b5163042d fixed envs and stopped warning 2021-03-29 17:03:36 -07:00
Steven Powell 352b331042 added addon tests 2021-03-29 14:42:55 -07:00
Steven Powell 411c54f41d added cloud shell test to GitHub jobbs 2021-03-29 14:42:32 -07:00
Steven Powell ba25b5a2c8 added cloud shell function tests 2021-03-29 14:42:32 -07:00
Sharif Elgamal c8e8c8fb99 testing macos docker tests again 2021-03-25 15:34:42 -07:00
Ilya Zuyev 246109d00d Restore test timeout 2021-03-23 19:54:17 -07:00
Ilya Zuyev b01e6478b7 debug: decrease timeout to 10 min 2021-03-23 18:40:05 -07:00
Ilya Zuyev a264c351b3 Add jenkins script logs 2021-03-23 15:37:34 -07:00
Ilya Zuyev 587ef87acb fixes 2021-03-23 10:44:52 -07:00
Ilya Zuyev adf7428c28 Restore common.sh 2021-03-22 10:48:13 -07:00
Ilya Zuyev d6572d87a2 Merge branch 'master' into ilyaz/arm64_integration_tests 2021-03-19 14:04:24 -07:00
Ilya Zuyev 7e45721c82 fix report paths 2021-03-18 10:45:43 -07:00