92604a3c00
simplify check_install_golang.sh invocation
2021-07-13 11:47:20 -07:00
aa92f4106c
Merge pull request #11921 from andriyDev/fix-set-pending-2
...
Use THE_COMMIT env var instead of ghprbActualCommit
2021-07-12 23:58:06 +00:00
0589a42fdf
Use -eq instead of == because Powershell bad.
2021-07-12 14:10:50 -07:00
c64ba2c080
Fix report scripts to print out only started environments, and use quotes around script names.
2021-07-12 10:10:54 -07:00
b6e55e6c97
Create common.ps1 to simplify Windows integration tests.
2021-07-09 13:27:02 -07:00
579bebda1a
fix script
2021-07-08 15:00:13 -07:00
baa86c389a
fix scripts
2021-07-08 13:43:10 -07:00
bc7995f81b
update contact to Medya
2021-07-07 15:14:53 -07:00
3afe680c92
Use THE_COMMIT env var instead of ghprbActualCommit.
2021-07-07 13:15:33 -07:00
50e07ae7ec
Move environment start saving up in minikube_set_pending.
2021-07-07 11:19:35 -07:00
ae294d2067
Make sync_tests.sh remove any _integration suffix.
2021-07-07 09:21:00 -07:00
429b00d4f0
Merge pull request #11857 from ilya-zuyev/ilyaz/upload_arm64_to_gcs
...
fix kvm2-arm64 scripts
2021-07-02 10:10:27 -04:00
a1300b1d32
Merge pull request #11874 from andriyDev/MoreCharts
...
More charts
2021-07-02 09:45:19 -04:00
5ecd53b1ea
Merge pull request #11794 from ilya-zuyev/ilyaz/test_report_links
...
Show GCS report links in integration test logs
2021-07-02 09:37:14 -04:00
7c45056827
Merge pull request #11851 from andriyDev/fix-flake-sync
...
Replace integration test "hooks" with standalone scripts
2021-07-01 16:17:54 -07:00
5d0eba44ec
Add test count/fail count chart to environment page.
2021-07-01 16:02:22 -07:00
a442d79877
Remove STARTED_ENVIRONMENTS from common.sh.
2021-07-01 15:53:52 -07:00
d1b6549fbb
Add duration graph to environment flake rates.
2021-07-01 14:29:19 -07:00
6e46d895dc
Merge branch 'master' into ilyaz/test_report_links
2021-07-01 13:51:14 -07:00
5ccd38c0f7
fix output formatting
2021-07-01 13:47:40 -07:00
3904c6deab
Ignore upload fail.
2021-07-01 13:32:20 -07:00
5dfb6726bd
Make upload_tests use a remote GCS file.
2021-07-01 13:32:20 -07:00
3b5675d9e0
fix
2021-07-01 13:31:44 -07:00
2beaea9fc1
fix
2021-07-01 12:27:06 -07:00
ea6d16db41
for PR builds: build kvm2-arm64 deb
2021-07-01 12:14:03 -07:00
b5caf568ac
Add growth column to flake list.
2021-07-01 12:01:09 -07:00
d8ffe3f9fa
Add rank column to flake rate list.
2021-07-01 11:47:40 -07:00
a203d5f644
Replace integration test "hooks" with register_tests to fill started_environments and sync_tests to fill finished environments.
2021-07-01 11:09:34 -07:00
a9157c2433
improve Windows Docker clean slate
2021-06-30 16:42:09 -07:00
c2f18d9d4b
Merge pull request #11841 from sharifelgamal/ugly-err
...
remove ugly error message from kicbase and ISO autobuild
2021-06-30 17:26:37 -04:00
d8f8e3faf7
Merge pull request #11803 from sharifelgamal/mac-test
...
try less parallelization for macOS tests
2021-06-30 14:17:48 -07:00
06c1da3076
make URLs easier to copy
2021-06-30 14:01:14 -07:00
a50406e269
Merge pull request #11767 from ilya-zuyev/ilyaz/arm64_kvm_release
...
Update release scripts to build arm64 version of kvm2 driver
2021-06-30 16:49:09 -04:00
1e7f8cbaa7
remove ugly error message from kicbase and ISO autobuild
2021-06-30 13:40:18 -07:00
323733c532
Merge pull request #11816 from andriyDev/FlakeRateSync
...
Report flakes only after synchronizing all integration tests
2021-06-30 16:38:08 -04:00
7ea94ed00a
Add license and comment describing what the script does.
2021-06-29 14:51:31 -07:00
e3883d0b56
Fix writing wrong files, and added better comments.
2021-06-29 14:47:13 -07:00
f2c64cdb2b
Add support for syncing Docker_Windows.
2021-06-29 13:32:54 -07:00
73e42a9a8c
change parallelization in code
2021-06-29 11:46:38 -07:00
858aab3f55
Create sync_tests.sh to be triggered by each integration test on completion.
2021-06-29 11:44:36 -07:00
065929ffd0
try less parallelization for macOS tests
2021-06-29 09:22:42 -07:00
bed20c522b
In integration test logs: show GCS https links to reports
2021-06-28 14:34:05 -07:00
4f114dafb9
Add comment to report_flakes.sh to see environment flake charts.
2021-06-28 09:19:43 -07:00
4d078ae82f
Merge pull request #11766 from andriyDev/EnvPage
...
Create page with all tests for an environment in flake rate charts
2021-06-25 19:27:00 -04:00
e9932aa7db
Improve error handling to actually render in the UI.
2021-06-25 11:13:46 -07:00
f57d7ae723
Create loading bar while downloading flake chart data.
2021-06-25 11:05:49 -07:00
637e8326fd
Implement proper body-by-lines iterator.
2021-06-25 10:47:06 -07:00
cb31ce2e7d
remove kvm2-arm64 rpm
2021-06-25 10:08:40 -07:00
eeaf03e4a3
Add name of test to each point in environment flake page.
2021-06-25 09:43:47 -07:00
b1ec38f808
Add links to charts for each individual test on environment page.
2021-06-25 09:39:13 -07:00
c067ea6cda
Create table to show all flake rates for a specific environment.
2021-06-25 09:39:13 -07:00
e22ddb9238
Compute flakeiness based on last 15 days and only chart top 10 flakiest tests.
2021-06-25 09:39:13 -07:00
9d41adbf06
Create page for viewing all tests for an environment.
2021-06-25 09:39:11 -07:00
fc6c4eb04e
Move existing formatting/charting code into its own function.
2021-06-25 09:29:54 -07:00
f404d5976f
Refactor flake chart data processing to simplify into two steps: aggregation and formatting.
2021-06-25 09:26:57 -07:00
0033bf7ed3
make targets for deb and rpm
2021-06-24 20:02:21 -07:00
a0c5634dfd
Make nicer fonts for test tooltips in flake charts.
2021-06-24 11:57:07 -07:00
1c7d6b719c
Add links to hashes in flake charts.
2021-06-24 11:51:00 -07:00
0ff73cf645
Group commit hashes into one entry rather than one entry per run.
2021-06-24 11:42:50 -07:00
fbf61e3e33
Fix running a non-existent command in upload_integration_report.
2021-06-22 14:55:49 -07:00
5501afa9ef
Merge pull request #11683 from andriyDev/FixNoFlakesComment
...
Fix flake rates being commented about when no failed tests are present.
2021-06-17 17:58:44 -04:00
7d9bcf8626
Merge pull request #11684 from andriyDev/ChangeFlakeColors
...
Update flake chart colors
2021-06-17 13:00:46 -04:00
300230bd5c
Update flake chart colors.
2021-06-17 09:41:40 -07:00
5b8b5ce102
Fix flake rates being commented about when no failed tests are present.
2021-06-17 09:28:27 -07:00
9f601ea393
Fix commenting to a PR instead of an issue.
2021-06-16 18:03:52 -07:00
c037e5f62f
Stop using sudo for check_install_gh.
2021-06-16 15:29:50 -07:00
231fbee7b5
Fix collect_data_manual not being formatted correctly.
2021-06-15 09:55:32 -07:00
6a9076391d
Merge pull request #11602 from andriyDev/Flakes
...
Create a system for generating public flake rate reporting.
2021-06-15 12:51:29 -04:00
1c1fdbff42
Make compute_flake_rate also compute average test duration.
2021-06-10 14:00:47 -07:00
728229c719
Add more environments to the allowed environments for commenting.
2021-06-10 13:36:23 -07:00
dc6cb0b671
Rename collect_data.sh to collect_data_manual.sh and make header comment more clear.
2021-06-10 13:30:35 -07:00
884216db9e
Make report_flakes.sh abort if there are no failed tests.
2021-06-10 13:27:00 -07:00
7e785c1c1e
Make collect_data.sh optimzie and upload to GCS automatically.
2021-06-10 13:19:05 -07:00
a98db3511e
Add description and example usage to all shell scripts.
2021-06-10 13:16:16 -07:00
2b3f7cedd7
Remove bootstrap from flake_chart.html.
2021-06-10 13:02:56 -07:00
ecaee4d932
Add better comments for optimize_data and process_data.
2021-06-10 11:16:44 -07:00
79f8de1bcb
Add comment for testEntry.
2021-06-10 11:11:34 -07:00
e9e7b85e02
Make types and functions private.
2021-06-10 11:08:44 -07:00
cc89907cca
add -Force to folder rm
2021-06-10 10:40:49 -07:00
e089973f65
Create SplitEntryMap type to simplify some definitions.
2021-06-09 15:21:43 -07:00
3b27578610
delete `minikube-integration` folder in case last test failed to delete it
2021-06-09 15:11:03 -07:00
fb8e4d982b
Clean up compute_flake_rate.go.
2021-06-08 13:06:28 -07:00
fcbae7eaa1
Make sure gh is present when running report_flakes.sh.
2021-06-08 11:54:08 -07:00
3aa922813c
Fix wrong number of parameters for report_flakes.sh.
2021-06-08 11:50:14 -07:00
716f690189
Change copyright to 2021.
2021-06-07 16:39:06 -07:00
139d7e3771
Fix lints in compute_flake_rate.go and compute_flake_rate_test.go.
2021-06-07 16:36:01 -07:00
8f953781a2
Create report_flakes script to comment on PRs about flake rates of failed tests.
2021-06-07 14:44:49 -07:00
7c46154600
Rename jenkins_upload_tests.sh to upload_tests.sh.
...
Since these scripts are already in the jenkins folder, having the jenkins prefix is redundant.
2021-06-07 14:12:31 -07:00
501b238841
Use "set -eu -o pipefail" for all scripts.
...
Previously failing commands in scripts wouldn't make them actually fail. Now it does!
2021-06-07 14:09:32 -07:00
9e7f1ebbf0
Make computing flake rates print out percentages (with fixed 2 decimal precision) rather than floats.
2021-06-07 13:49:40 -07:00
a80f3bc5ae
Add license to upload_tests script.
2021-06-07 13:49:05 -07:00
b39f171268
ensure Windows integration tests are ephemeral
2021-06-04 14:08:37 -07:00
cec82877d8
Format flake rates into CSV containing environment, test, and flake rate.
2021-06-03 14:25:04 -07:00
d245cfcdf7
Move all flake rate files to Jenkins to allow auto-upload.
2021-06-03 14:12:03 -07:00
40fdbe61ae
Allow Jenkins to append to the flake rate data.
2021-06-03 14:01:06 -07:00
74fe0e9f62
bump gopogh
2021-06-02 16:30:50 -07:00
db2e02c94f
Merge pull request #11448 from sharifelgamal/macos-docker
...
ci: Add script to make sure docker is running for macos integration tests
2021-05-21 13:26:34 -07:00
40fd08e5fa
adding check if docker is already running
2021-05-20 15:31:31 -07:00
2620012bed
simplify code a bit
2021-05-19 15:00:30 -07:00
a4c7e5b6dc
fix permissions
2021-05-19 09:45:04 -07:00
b78415fcd0
add logs
2021-05-18 22:04:25 -07:00
443c0c00a1
add logs
2021-05-18 22:03:57 -07:00
6da92d44f6
Fix golang installation script for arm64 platform
2021-05-18 22:00:57 -07:00
f319ac784c
Add script to make sure docker is running for macos integration tests
2021-05-18 16:54:09 -07:00
468e2e85bb
git username
2021-05-13 10:43:55 -07:00
ad4716813a
fix if statements
2021-05-13 10:16:04 -07:00
98e7cbf4d3
perms
2021-05-13 10:12:12 -07:00
3a2bad6d28
don't automatically bump version
2021-05-13 09:51:31 -07:00
3042313322
don't fail on docker error
2021-05-13 09:42:51 -07:00
edd1230767
add script to automatically release storage provisioner
2021-05-13 09:40:55 -07:00
9e57c747e2
Merge pull request #11351 from afbjorklund/go-1.16.4
...
Upgrade go version from 1.16.1 to 1.16.4
2021-05-11 14:53:49 -07:00
c136fe3cfd
Merge pull request #11060 from afbjorklund/retro-arch
...
Allow building minikube for outdated architectures
2021-05-11 12:22:03 -07:00
118d201a73
Upgrade go version from 1.16.1 to 1.16.4
2021-05-10 07:16:24 +02:00
ac624bff80
Add missing arm64 tarballs to the release page
...
The arm64 build targets for the drivers are currently missing,
but they should be downloaded at runtime anyway so exclude them.
2021-05-09 10:11:22 +02:00
fea1be9d51
unify integration test names for uploading
2021-05-07 15:35:38 -07:00
603e49189e
allow install docker to fail
2021-05-07 10:07:08 -07:00
290230831e
break OS_ARCH into OS and ARCH
2021-05-06 16:23:41 -07:00
73291c04c7
make common executable
2021-05-06 13:06:12 -07:00
ad885687de
actually common.sh is a better choice
2021-05-06 13:05:02 -07:00
63b773e88b
combine run_tests.sh and common.sh for integration testing
2021-05-06 12:43:16 -07:00
be24532339
fix other API instances of access token for tests
2021-05-05 15:53:36 -07:00
90d148faa7
change authentication for jenkins job
2021-05-05 14:15:33 -07:00
cdb0de091a
full suite for docker
2021-05-04 12:16:13 -07:00
debca7805e
i just wanna see if it works ok
2021-05-04 11:07:36 -07:00
7a4855df80
take 2
2021-05-04 10:42:09 -07:00
3daad34d4e
fix up loop
2021-05-04 10:01:52 -07:00
384cb73b35
add ability for custom file name for uploading files
2021-05-03 17:53:39 -07:00
4f381cc1e6
Merge branch 'master' of github.com:kubernetes/minikube into macstadium
2021-05-03 17:30:20 -07:00
4186087e64
Revert "Run test2json during the test and not afterwards"
2021-05-03 17:23:24 -07:00
c14051eb35
add pidof to macos machines
2021-05-03 16:43:01 -07:00
a08f44b746
make hyperkit tests full suite
2021-05-03 15:45:47 -07:00
b090f4901c
make sure timeout is installed on macos
2021-05-03 13:27:11 -07:00
17d677dfc9
small changes
2021-05-03 13:21:56 -07:00
b4379c326f
Run test2json during the test and not afterwards
...
Running it after the test is completed, means that the timestamps
of the output will be wrong (not reflecting the actual test run).
This should use "go test -json" instead of the "test2json" pipe,
but need something like "gotestsum" to show both out and json...
2021-05-03 08:08:14 +02:00
82e9a5248a
fixed gsutil copy from releases-beta.json
2021-04-30 17:22:21 -07:00
7cce80e555
trying hyperkit??
2021-04-30 11:24:27 -07:00
bb9fa3d120
hey, uh, don't kill docker please
2021-04-30 10:44:09 -07:00
d9d251ac38
use external upload script
2021-04-30 08:20:24 -07:00
f26b2df8c3
install pstree on macos as well
2021-04-29 16:36:00 -07:00
eb3f2b7516
Merge branch 'master' of github.com:kubernetes/minikube into macstadium
2021-04-29 16:16:20 -07:00
ac2b98d744
Merge pull request #11169 from spowelljr/addBetaNotifications
...
Add opt-in notifications for beta releases
2021-04-29 14:03:59 -07:00
77dd7a7cd6
Merge branch 'master' of github.com:kubernetes/minikube into macstadium
2021-04-28 18:56:24 -07:00
a3b52560cd
that was a bad idea
2021-04-28 18:49:24 -07:00
7ed18e5811
try to propagate sudo creds
2021-04-28 18:21:24 -07:00
285457ebda
updated releases script to updates releases-beta.json
2021-04-27 13:34:08 -07:00
0ed1c923a9
Make sure to capture errors in auto kicbase builds
2021-04-26 17:54:07 -07:00
79ba91cd44
fix flake integration tests: cleanups and timeouts
2021-04-23 22:19:59 +01:00
9fded7695f
Add retro binaries to the all target and release
2021-04-18 13:10:50 +02:00
56517303ff
Merge pull request #11011 from sharifelgamal/prbot
...
minikube-pr-bot enhancements
2021-04-09 09:23:54 -07:00
1665c7801d
revert pipefail
2021-04-08 10:57:56 -07:00
2ce5ac0467
run minikube delete before testing
2021-04-07 15:28:12 -07:00
dad89e8223
skip docker for now
2021-04-07 14:12:59 -07:00
7836e101f8
Merge branch 'master' of github.com:kubernetes/minikube into prbot
2021-04-07 14:05:07 -07:00
0aee73d612
skip trying to install docker in CI
2021-04-07 11:21:21 -07:00
400fcc1b9d
use params on correct script
2021-04-07 09:54:39 -07:00
68b903cbb6
escapism
2021-04-07 09:04:47 -07:00
493f7f8edc
fixes
2021-04-06 18:59:04 -07:00
57eb831883
fix pathing
2021-04-06 18:20:41 -07:00
782bdae4ed
lint
2021-04-06 17:28:22 -07:00
84f2c86a50
minikube-pr-bot enhancements
2021-04-06 17:07:43 -07:00
c3ae5fa8ed
catch auto kicbase failures properly
2021-04-05 15:13:20 -07:00
edd6321694
make sure to capture failures through pipes
2021-04-01 12:29:08 -07:00
14cde713bd
Fix unit test failing boilerplate, TestGenerateDocs
2021-04-01 21:22:05 +09:00
268c53e956
Merge pull request #10917 from spowelljr/addCloudShellTest
...
Added cloud shell functional tests
2021-03-30 14:57:04 -07:00
197aca6e1d
rename to docker_cloud_shell
2021-03-30 09:30:50 -07:00
6db49ee5eb
Update powershell script to install kubectl ver 1.20 on jenkins.
2021-03-30 09:22:48 -07:00
5b5163042d
fixed envs and stopped warning
2021-03-29 17:03:36 -07:00
352b331042
added addon tests
2021-03-29 14:42:55 -07:00
411c54f41d
added cloud shell test to GitHub jobbs
2021-03-29 14:42:32 -07:00
ba25b5a2c8
added cloud shell function tests
2021-03-29 14:42:32 -07:00
c8e8c8fb99
testing macos docker tests again
2021-03-25 15:34:42 -07:00
246109d00d
Restore test timeout
2021-03-23 19:54:17 -07:00
b01e6478b7
debug: decrease timeout to 10 min
2021-03-23 18:40:05 -07:00
a264c351b3
Add jenkins script logs
2021-03-23 15:37:34 -07:00
587ef87acb
fixes
2021-03-23 10:44:52 -07:00
adf7428c28
Restore common.sh
2021-03-22 10:48:13 -07:00
d6572d87a2
Merge branch 'master' into ilyaz/arm64_integration_tests
2021-03-19 14:04:24 -07:00
7e45721c82
fix report paths
2021-03-18 10:45:43 -07:00
1adf810ea3
remove debug 'ls'
2021-03-18 10:31:14 -07:00
6bfc73c1e3
debug logs
2021-03-17 11:01:26 -07:00
c7344212cd
Add test scripts for containerd and crio runtimes
2021-03-15 16:44:25 -07:00
6804e02b1f
Fix kubectl installation
2021-03-15 16:14:49 -07:00
2165d89cc5
Fix kubectl installation
2021-03-15 16:10:14 -07:00
f3b9443111
fix script name
2021-03-15 15:43:30 -07:00
74866e1b9f
update set_pending.sh
2021-03-15 15:28:35 -07:00
bdde5acf22
Restore common.sh; use run_tests.sh for arm jobs instead
2021-03-15 15:00:10 -07:00
781e3ea105
add cleanup script for docker windows machine
2021-03-15 14:06:11 -07:00
f95d43a2c7
Merge pull request #10835 from sharifelgamal/prune-windows
...
make sure to prune docker on windows integration test machines
2021-03-15 13:27:05 -07:00
bc5d846a30
point to raw logs when no gopogh
2021-03-15 13:05:54 -07:00
ce3227422e
force
2021-03-15 13:03:40 -07:00
fb8b25cb04
make sure to prune docker
2021-03-15 12:50:47 -07:00
953ddeff2a
update jenkins scripts
2021-03-15 11:19:49 -07:00
93aae1fb81
Add deb/rpm packaging for arm32/armv7 as well
2021-03-15 08:54:35 +01:00
7789bdfc35
Refactor: use variables for package revisions
2021-03-15 07:35:39 +01:00
2f8070ace1
Add rpm and deb packaging for ppc64le and s390x
2021-03-15 07:30:07 +01:00
36b0ec8243
debug prints
2021-03-12 13:14:15 -08:00
9ca7392688
add upload_integration_report.sh jenkins script
2021-03-11 16:55:00 -08:00
69ae6d0e54
updating latest release on front page on release
2021-03-10 12:12:16 -08:00
65acaa745d
update common.sh test script
2021-03-10 10:33:34 -08:00
232f69ca35
Merge pull request #10767 from sharifelgamal/auto-error
...
print out error on failed iso and kicbase builds
2021-03-09 20:30:11 -08:00
Ilya Zuyev
Steven Powell
Andriy Dzikh
Steven Powell
Medya Ghazizadeh
Sharif Elgamal
Medya Gh
Anders F Björklund
Predrag Rogic
Kent Iso
hetong07