Commit Graph

67 Commits (0fc47bc6921f247a5373761b9f2c0094a30cc068)

Author SHA1 Message Date
docmerlin (j. Emrys Landivar) 19fe098888 chore(ci): update go-tools 2019-08-22 10:55:05 -05:00
Russ Savage 4172dfd09e
fix(circleci): add protoc to release build (#14658) 2019-08-14 12:24:27 -07:00
Andrew Watkins 7d9ec64eec
build(client): generate client on each build (#14591)
* chore: add new types for NotiicationRules

* build(client): remove client and build each build

* chore: update gitignore to exclude generated client

* fix: allow client dir to be empty

* docs: add README to client dir

* fix(build): add autogen client to eslintignore

* build: gen client for ci js tests
2019-08-07 13:42:35 -07:00
Chris Goller d3821e12dd
ci(nightly): install protoc (#14486) 2019-07-26 16:21:14 -05:00
Russ Savage b28fb15598
add bzr to release build (#14474) 2019-07-25 16:46:15 -07:00
Christopher Wolff 42db95f359 test(circleci): install bzr before building and running e2e tests 2019-07-24 14:49:57 -07:00
Christopher Wolff 035739b5b7 test(circleci): install bzr before running go tests 2019-07-24 14:33:34 -07:00
Chris Goller 510f7bb057 fix(task): lookup fully hydrated task after creation (#13709)
* fix(task): lookup fully hydrated task after creation

* ci(circle): save go race and litmus test results artifact
2019-05-01 14:54:27 -06:00
Mark Rushakoff 3507027dc0 ci: use go1.12 on CircleCI
And update go.sum from a go1.12 mod tidy.
2019-04-12 13:38:48 -07:00
Brandon Farmer 91dbf02c7f Remove npm caching, ensure fresh dependencies are installed 2019-04-09 12:57:37 -07:00
Kelvin Wang 1cf600aca9 remove proto 2019-04-03 15:42:25 -04:00
Mark Rushakoff 6cb90686ff ci: fail build if binary files committed
Binary files can be whitelisted with the special line 'Adds-Binary:
<path/to/binary/file>' included in the commit message body. Deliberately
checked-in binary files should be very rare.

With minimal effort, this could probably be repurposed as a local
postcommit hook.
2019-03-15 09:17:07 -07:00
Gershon Shif d0694f28b3
ci(litmus): do not run litmus tests on forked PRs (#12063)
* ci(litmus): do not run litmus tests on forked PRs

- add a step to check if PR is from fork. If it is, then stop execution of the step and successfully return.
- Fix for https://github.com/influxdata/influxdb/issues/11965
2019-02-21 12:28:38 -08:00
Michael Desa 6a8a1fce32 feat(kv): implemented key/value store with end-to-end integration tests
* feat(kv:inmem:bolt): implement user service in a kv

* refactor(kv): use consistent func receiver name

* feat(kv): add initial basic auth service

* refactor(passwords): move auth interface into own file

* refactor(passwords): rename basic auth files to passwords

* refactor(passwords): rename from BasicAuth to Passwords

* refactor(kv): copy bolt user test into kv

Co-authored-by: Michael Desa <mjdesa@gmail.com>

* feat(kv): add inmem testing to kv store

* fix(kv): remove extra user index initialization

* feat(kv): attempt at making errors nice

* fix(http): return not found error if filter is invalid

* fix(http): s/platform/influxdb/ for user service

* fix(http): s/platform/influxdb/ for user service

* feat(kv): initial port of telegraf configs to kv

* feat(kv): first pass at migrating bolt org service to kv

* feat(kv): first pass at bucket service

* feat(kv): first pass at migrating kvlog to kv package

* feat(kv): add resource op logs

* feat(kv): first pass at user resource mapping migration

* feat(kv): add urm usage to bucket and org services

* feat(kv): first pass at kv authz service

* feat(kv): add cascading auth delete for users

* feat(kv): first pass d authorizer.OrganizationService in kv

* feat(cmd/influxd/launcher): user kv services where appropriate

* fix(kv): initialize authorizations

* fix(influxdb): use same buckets while slowly migrating stuff

* fix(kv): make staticcheck pass

* feat(kv): add dashboards to kv

review: make suggestions from pr review

fix: use common bucket names for bolt/kv stores

* test(kv): add complete password test coverage

* chore(kv): fixes for staticcheck

* feat(kv): implement labels generically on kv

* feat(kv): implement macro service

* feat(kv): add source service

* feat(kv): add session service

* feat(kv): add kv secret service

* refactor(kv): update telegraf and urm with error messages

* feat(kv): add lookup service

* feat(kv): add kv onboarding service

* refactor(kv): update telegraf to avoid repetition

* feat(cmd/influxd): use kv lookup service

* feat(kv): add telegraf to lookup service

* feat(cmd/influxd): use kv telegraf service

* feat(kv): initial port of scrapers in bolt to kv

* feat(kv): update scraper error messaging

* feat(cmd/influxd): add kv scraper

* feat(kv): add inmem backend tests

* refactor(kv): copy paste errors

* refactor(kv): add code to password errors

* fix(testing): update error messages for incorrect passwords

* feat(kv:inmem:bolt): implement user service in a kv

* refactor(kv): use consistent func receiver name

* refactor(kv): copy bolt user test into kv

Co-authored-by: Michael Desa <mjdesa@gmail.com>

* feat(kv): add inmem testing to kv store

* fix(kv): remove extra user index initialization

* feat(kv): attempt at making errors nice

* fix(http): return not found error if filter is invalid

* fix(http): s/platform/influxdb/ for user service

* feat(kv): first pass at migrating bolt org service to kv

* feat(kv): first pass at bucket service

* feat(kv): first pass at migrating kvlog to kv package

* feat(kv): add resource op logs

* feat(kv): first pass at user resource mapping migration

* feat(kv): add urm usage to bucket and org services

* feat(kv): first pass at kv authz service

* feat(kv): add cascading auth delete for users

* feat(kv): first pass d authorizer.OrganizationService in kv

* feat(cmd/influxd/launcher): user kv services where appropriate

* feat(kv): add initial basic auth service

* refactor(passwords): move auth interface into own file

* refactor(passwords): rename basic auth files to passwords

* fix(http): s/platform/influxdb/ for user service

* fix(kv): initialize authorizations

* fix(influxdb): use same buckets while slowly migrating stuff

* fix(kv): make staticcheck pass

* feat(kv): add dashboards to kv

review: make suggestions from pr review

fix: use common bucket names for bolt/kv stores

* feat(kv): implement labels generically on kv

* refactor(passwords): rename from BasicAuth to Passwords

* test(kv): add complete password test coverage

* chore(kv): fixes for staticcheck

* feat(kv): implement macro service

* feat(kv): add source service

* feat(kv): add session service

* feat(kv): initial port of telegraf configs to kv

* feat(kv): initial port of scrapers in bolt to kv

* feat(kv): add kv secret service

* refactor(kv): update telegraf and urm with error messages

* feat(kv): add lookup service

* feat(kv): add kv onboarding service

* refactor(kv): update telegraf to avoid repetition

* feat(cmd/influxd): use kv lookup service

* feat(kv): add telegraf to lookup service

* feat(cmd/influxd): use kv telegraf service

* feat(kv): update scraper error messaging

* feat(cmd/influxd): add kv scraper

* feat(kv): add inmem backend tests

* refactor(kv): copy paste errors

* refactor(kv): add code to password errors

* fix(testing): update error messages for incorrect passwords

* feat(http): initial support for flushing all key/values from kv store

* feat(kv): rename macro to variable

* feat(cmd/influxd/launcher): user kv services where appropriate

* refactor(passwords): rename from BasicAuth to Passwords

* feat(kv): implement macro service

* test(ui): introduce cypress

* test(ui): introduce first typescript test

* test(ui/e2e): add ci job

* chore: update gitignore to ignore test outputs

* feat(inmem): in memory influxdb

* test(e2e): adding pinger that checks if influxdb is alive

* hackathon

* hack

* hack

* hack

* hack

* Revert "feat(inmem): in memory influxdb"

This reverts commit 30ddf032003e704643b07ce80df61c3299ea7295.

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* hack

* chore: lint ignore node_modules

* hack

* hack

* hack

* add user and flush

* hack

* remove unused vars

* hack

* hack

* ci(circle): prefix e2e artifacts

* change test to testid

* update cypress

* moar testid

* fix npm warnings

* remove absolte path

* chore(ci): remove /home/circleci proto mkdir hack

* wip: crud resources e2e

* fix(inmem): use inmem kv store services

* test(dashboard): add first dashboard crud tests

* hack

* undo hack

* fix: use response from setup for orgID

* chore: wip

* add convenience getByTitle function

* test(e2e): ui can create orgs

* test(e2e): add test for org deletion and update

* test(e2e): introduce task creation test

* test(e2e): create and update of buckets on org view

* chore: move types to declaration file

* chore: use route fixture in dashboard tests

* chore(ci): hack back

* test(ui): update snapshots

* chore: package-lock

* chore: remove macros

* fix: launcher rebase issues

* fix: compile errors

* fix: compile errors

* feat(cmd/influxdb): add explicit testing, asset-path, and store flags

Co-authored-by: Andrew Watkins <watts@influxdb.com>

* fix(cmd/influxd): set default HTTP handler and flags

Co-authored-by: Andrew Watkins <watts@influxdb.com>

* build(Makefile): add run-e2e and PHONY

* feat(kv:inmem:bolt): implement user service in a kv

* refactor(kv): use consistent func receiver name

* feat(kv): add initial basic auth service

* refactor(passwords): move auth interface into own file

* refactor(passwords): rename basic auth files to passwords

* refactor(passwords): rename from BasicAuth to Passwords

* refactor(kv): copy bolt user test into kv

Co-authored-by: Michael Desa <mjdesa@gmail.com>

* feat(kv): add inmem testing to kv store

* fix(kv): remove extra user index initialization

* feat(kv): attempt at making errors nice

* fix(http): return not found error if filter is invalid

* fix(http): s/platform/influxdb/ for user service

* fix(http): s/platform/influxdb/ for user service

* feat(kv): initial port of telegraf configs to kv

* feat(kv): initial port of scrapers in bolt to kv

* feat(kv): first pass at migrating bolt org service to kv

* feat(kv): first pass at bucket service

* feat(kv): first pass at migrating kvlog to kv package

* feat(kv): add resource op logs

* feat(kv): first pass at user resource mapping migration

* feat(kv): add urm usage to bucket and org services

* feat(kv): first pass at kv authz service

* feat(kv): add cascading auth delete for users

* feat(kv): first pass d authorizer.OrganizationService in kv

* feat(cmd/influxd/launcher): user kv services where appropriate

* fix(kv): initialize authorizations

* fix(influxdb): use same buckets while slowly migrating stuff

* fix(kv): make staticcheck pass

* feat(kv): add dashboards to kv

review: make suggestions from pr review

fix: use common bucket names for bolt/kv stores

* test(kv): add complete password test coverage

* chore(kv): fixes for staticcheck

* feat(kv): implement labels generically on kv

* feat(kv): implement macro service

* feat(kv): add source service

* feat(kv): add session service

* feat(kv): add kv secret service

* refactor(kv): update telegraf and urm with error messages

* feat(kv): add lookup service

* feat(kv): add kv onboarding service

* refactor(kv): update telegraf to avoid repetition

* feat(cmd/influxd): use kv lookup service

* feat(kv): add telegraf to lookup service

* feat(cmd/influxd): use kv telegraf service

* feat(kv): update scraper error messaging

* feat(cmd/influxd): add kv scraper

* feat(kv): add inmem backend tests

* refactor(kv): copy paste errors

* refactor(kv): add code to password errors

* fix(testing): update error messages for incorrect passwords

* feat(kv): rename macro to variable

* refactor(kv): auth/bucket/org/user unique checks return errors now

* feat(inmem): add way to get all bucket names from store

* feat(inmem): Buckets to return slice of bytes rather than strings

* feat(inmem): add locks around Buckets to avoid races

* feat(cmd/influx): check for unauthorized error in wrapCheckSetup

* chore(e2e): add video and screenshot artifcats to gitignore

* docs(ci): add build instructions for e2e tests

* feat(kv): add id lookup for authorized resources
2019-02-19 17:47:19 -06:00
Gershon Shif 0147470353
fix nightly (#11790)
- add persist_to_worspace to deploy build job
2019-02-09 22:57:42 -08:00
Gershon Shif ac6545e9ac
use attach_workspace for litmus nightly builds (#11785) 2019-02-08 16:55:45 -08:00
Gershon Shif aa66aebaaa
enable Litmus Smoke tests on daily PRs (#11747)
* enable Litmus Smoke tests on daily PRs

- created a litmus_daily job
- added persist_to_workspace to build job to have access to influxd binary
- added litmus_daily to build workflow
- added two script files, litmus_success_notify.sh and litmus_fail_notify.sh to `etc` directory
- added the above script files to the one to be shared in the workspace
- updated litmus_daily and litmus_nightly jobs to use scripts for notifications.
2019-02-07 17:21:56 -08:00
Gershon Shif f3cd889d1e
Add slack notifications to litmus nightly runs (#11648)
- Add a conditional slack notifications to litmus nightly job.
2019-01-31 15:13:34 -08:00
Gershon Shif c72363c7ec
Add litmus test runs to nightly build (#11620) 2019-01-25 12:18:56 -08:00
Luke Morris 954bc8df78 ci: build and release for pushed github tags
Co-authored-by: Mark Rushakoff <mark@influxdb.com>
Co-authored-by: Chris Goller <goller@gmail.com>
2019-01-23 13:24:28 -08:00
Chris Goller a0121c8819 ci(goreleaser): create a release version of goreleaser
Co-authored-by: Luke Morris <lukevmorris@gmail.com>
Co-authored-by: Mark Rushakoff <mark@influxdata.com>
2019-01-23 14:19:05 -06:00
Chris Goller b9cfc72d25 ci(circle): decrease the number of parallel race tests
Trying to not get race tests killed by circle by decreasing the number of parallel tests run.
2019-01-22 22:18:14 -06:00
AJ Bond 08ae5647bf chore(ci): Restore nightly schedule 2019-01-16 14:26:08 -05:00
AJ Bond cd11b348ed fix(ui): Fix UI generation issues
This issue allows for the ui to be generated during the build proccess
2019-01-15 20:45:38 -05:00
AJ Bond f7b6bfacf7 chore(ci): Fix nightly build bug
The project is currently using goreleaser to manage building nightly binaries, docker images and uploads to s3.
The tool has a strict dependency on semantic versioned tags. InfluxDB history does not have a valid semantic tag causing the tool to fail. This commit creates a valid tag for the current time to allow nightly builds to continue.
2019-01-14 17:30:27 -05:00
Mark Rushakoff d73d73c0d4 chore: rename imports from platform to influxdb
I did this with a dumb editor macro, so some comments changed too.

Also rename root package from platform to influxdb.

In interest of minimizing risk, anyone importing the root package has
now aliased it to "platform" so that no changes beyond imports were
necessary in those files.

Lastly, replace the old platform module to local path /dev/null so that
nobody can accidentally reintroduce a platform dependency while
migrating platform code to influxdb.
2019-01-09 20:51:47 -08:00
AJ Bond e699a209e6 chore(ci): Update schedule back to single nightly build 2018-12-21 17:01:09 -05:00
AJ Bond 89b5ad0c86 chore(ci): Update trigger schedule 2018-12-21 16:55:37 -05:00
ABond 0f8f169558
Merge pull request #2074 from influxdata/chore/true-nightlies
chore(CircleCI): turn off deploy on commits to master
2018-12-20 13:11:23 -05:00
AJ Bond da67b392da chore(ci): Update make to build for each PR 2018-12-20 12:13:41 -05:00
Nathaniel Cook bd2105c923 chore(CircleCI): turn off deploy on commits to master 2018-12-20 09:34:26 -07:00
Mark Rushakoff c2d88d4e70 ci: ensure go.sum matches original file from checkout
In go1.11, go mod vendor can modify go.sum when go.mod contains replace
directives. This behavior has been fixed in go1.12, so just work around
it for now.

Fixes #2056.
2018-12-20 10:04:55 -05:00
zhulongcheng a1f3ca5151 fix(ci): add required jobs 2018-12-16 18:21:33 +08:00
AJ Bond ac61849bc4 chore(ci): Setup nightly build 2018-12-13 16:48:09 -05:00
Mark Rushakoff c7064463a4 ci: use -p=4 on circle
The docker container we're using has 2 vCPUs. -p=8 was working fine for
a while, but diagnosing #1832 looks like the tsi1.test process was
likely getting OOM-killed. Reducing from -p=8 to -p=4 ought to reduce
memory pressure enough to avoid OOM kills, hopefully.

Also remove a stale TODO.
2018-12-13 08:46:00 -08:00
AJ Bond 5a0bcd7f2c chore(ci): Reset CircleCI cache logic 2018-12-07 14:17:03 -08:00
Michael Desa a4a9e1b45f chore: remove make test-integration from circle ci tests
Temporarily remove the call to make test-integration so that nightly
builds are not broken.

Related to https://github.com/influxdata/platform/issues/1676
2018-12-04 15:17:45 -05:00
Brandon Farmer f04d420709 Remove yarn in favor of just npm 2018-11-30 17:02:31 -08:00
Michael Desa 56de056085 feat(vault): add vault implementation of secret service
test(platform): run testcontainer integration tests for nightly release

Integration tests for the vault secret service using testcontiners
should not run along with unit tests, however, they should run on some
regular schedule. This commit introduces `make test-integration` which
runs integration tests for vault using testcontainers. The command introduced
relies on docker being available on the host it is executed on.

chore(platform): make go modules tidy

chore: try to fix go mod

chore(platform): remove explicit logrus dependency

chore(platform): run go mod tidy

chore(platform): replace github.com/Sirupsen/logrus with github.com/sirupsen/logrus

chore(platform): update docker dependency

feat(vault): add vault implementation of secret service

test(platform): run testcontainer integration tests for nightly release

Integration tests for the vault secret service using testcontiners
should not run along with unit tests, however, they should run on some
regular schedule. This commit introduces `make test-integration` which
runs integration tests for vault using testcontainers. The command introduced
relies on docker being available on the host it is executed on.

chore(platform): make go modules tidy

chore: try to fix go mod

chore(platform): run go mod tidy

feat(vault): add vault implementation of secret service

chore(platform): make go modules tidy

feat(platform): add Put/Patch/Delete methods on secret service

feat(vault): add Put/Patch/Delete methods on vault secret service

feat(http): add http handler methods for secret service

feat(bolt): add Put/Delete/Patch methods to bolt secret service

feat(testing): add tests for Put/Patch/Delete methods in secret service

feat(mock): add mock secret service

feat(http): add tests for secrets endpoints

feat(http): update swagger for secrets endpoints

chore: run go mod tidy
2018-11-30 13:07:32 -08:00
Edd Robinson 2471024253 Use staticcheck on next branch 2018-11-30 10:53:53 +00:00
Mark Rushakoff a7fdd17815 ci: re-enable race builds in circle config
I looked through the past few days of Circle Go failures, and they all
appeared to be real test errors, indicating that the -p=8 flag most
likely fixed the linker OOMs we were seeing.

If the race-enabled tests continue to OOM, we can try setting -p=2 to
match the number of CPUs actually available on our Circle container.
2018-11-12 08:24:43 -08:00
Mark Rushakoff d8dedc5644 ci: use -p=8 in GOFLAGS to reduce linker OOMs
The environment Go runs in thinks there are 32 CPUs, but according to
https://circleci.com/docs/2.0/configuration-reference/#resource_class
that's a known issue, and only 2 CPUs are actually available.

We're still overallocating with -p=8, so if we continue to get OOMs we
may need to reduce that further.
2018-11-02 17:21:33 -07:00
Mark Rushakoff 68c0ad29e2 ci: add megacheck to tools.go 2018-11-01 13:25:22 -07:00
Mark Rushakoff b37279c50e ci: remove 2/3 disabled exit-non-zero flags for megacheck
The one remaining failing static check is in a pigeon-generated promql
file. It looks like megacheck is supposed to ignore generated files by
default, so it's unclear at this time if this is a bug in megacheck, or
if fixing pigeon is the only path forward.
2018-11-01 12:54:46 -07:00
Mark Rushakoff 9acc251ab0 ci: re-enable megacheck 2018-11-01 12:46:33 -07:00
Michael Desa fdbec9303d chore(ui): update misc build files related to moving chronograf/ui to ui 2018-10-29 14:00:45 -04:00
Chris Goller 5c5b5f50c8 ci(tests): remove go race tests from circle
We think we are being OOM-killed as our plan as 4 GB of ram.
2018-10-26 15:56:11 -05:00
Jonathan A. Sternberg f3b2959e89
feat: save and restore the /go/pkg/mod directory in circleci 2018-10-11 16:11:36 -05:00
Jonathan A. Sternberg 0e14b63425
feat: checktidy will check the go.mod and go.sum files in circleci 2018-10-10 15:35:02 -05:00
Chris Goller 2f2334a3f3 ci(gofmt): check go formatting with each PR 2018-10-08 17:23:54 -05:00