Go to file
Daniel Moran 10fcc2bf1d
fix(influxql): set correct Content-Type on v1 query responses (#20565)
2021-01-22 07:31:52 -08:00
.circleci build: add guards against using secrets in forked PR builds (#20506) 2021-01-13 09:39:05 -08:00
.github chore(storage): remove storage-team from CODEOWNERS (#19574) 2020-09-21 09:32:05 -07:00
authorization fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
authorizer chore(documents): reinstate minimal read-only document store for dashboard templates 2020-11-16 12:41:26 +00:00
bolt fix: inject more specific error message for bolt on shared FS (#20489) 2021-01-11 13:08:47 -08:00
checks refactor(kv): delete deprecated kv service code 2020-11-16 12:41:26 +00:00
chronograf chore: remove references to chronograf (#20392) 2021-01-05 07:46:58 -08:00
cmd feat(cmd/influxd): add `nats-max-payload-bytes` config option to influxd (#20564) 2021-01-20 12:44:43 -08:00
context refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
dashboards test: modify tests for changes in influxdb.DefaultPageSize 2020-11-17 19:48:52 -06:00
dbrp fix(dbrp): improve DBRP API validation errors (#20409) 2021-01-07 09:08:06 -08:00
docker build: adjust emulator setup and ordering for Docker cross-build (#20503) 2021-01-12 10:41:13 -08:00
docs build: remove npm replace with yarn (#14176) 2019-06-21 16:19:42 -07:00
e2e build: clean up our CircleCI configs (#20397) 2020-12-22 12:38:30 -08:00
etc fix: switch port to 8086 2020-09-03 14:40:29 -07:00
flux refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
fluxinit refactor: replace builtin package with fluxinit/static (#3304) (#19909) 2020-11-05 16:54:28 -08:00
gather fix: Allow self signed certificates to ScraperTarget (#20047) 2020-11-17 13:35:41 -05:00
http fix(influxql): set correct Content-Type on v1 query responses (#20565) 2021-01-22 07:31:52 -08:00
influxql fix(influxql): set correct Content-Type on v1 query responses (#20565) 2021-01-22 07:31:52 -08:00
inmem fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
internal refactor(telegraf): remove references to kv service telegraf service implementation 2020-11-04 15:53:02 +00:00
jsonweb feat: Add initial OSS-Fuzz testing integration 2020-07-07 11:46:35 -07:00
kit fix(kit/cli): fix loading of .yml config files (#20522) 2021-01-15 17:04:20 -08:00
kv fix(kv): add KV migration to repair DBRP mappings broken by schema change (#20168) 2020-11-25 12:49:45 -05:00
label refactor(kv): delete deprecated kv service code 2020-11-16 12:41:26 +00:00
logger fix(tsdb): never use an inmem index (#20313) 2020-12-23 07:46:57 -08:00
mock chore(documents): reinstate minimal read-only document store for dashboard templates 2020-11-16 12:41:26 +00:00
models fix(models): grow tag index buffer if needed (#20137) 2020-11-23 14:06:12 -05:00
nats chore: Remove fragile nats port assignment loop 2020-11-13 09:13:48 +11:00
notification refactor(kv): delete deprecated kv service code 2020-11-16 12:41:26 +00:00
pkg fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
pkger feat(geo-widget): pkger support added 2020-12-18 19:37:08 +01:00
predicate feat(tsdb): Implement delete with predicate. 2020-12-02 14:55:02 -07:00
prometheus chore: update staticcheck and fix newly identified lint checks (#18737) 2020-06-26 18:54:09 -05:00
query fix(tsdb): never use an inmem index (#20313) 2020-12-23 07:46:57 -08:00
rand refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
resource refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
scripts build: rewrite our CI/CD pipeline to make ARM64 docker build work (#20484) 2021-01-11 15:01:09 -08:00
secret fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
session fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
snowflake refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
source refactor(kv): delete deprecated kv service code 2020-11-16 12:41:26 +00:00
storage fix(tsdb): never use an inmem index (#20313) 2020-12-23 07:46:57 -08:00
task chore(flux): update Flux to v0.101.0 (#20554) 2021-01-21 12:30:51 -08:00
telegraf fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
telemetry refactor: Replace ctx.Done() with ctx.Err() (#19546) 2020-09-16 12:20:09 -04:00
tenant fix(onboarding): don't ignore failures to set initial password (#20317) 2020-12-16 06:43:43 -08:00
testing fix: Add a ByOrgID index to DBRP 2020-11-24 10:28:00 +11:00
tests refactor: simplify how we set the top-level influxd logger (#20374) 2020-12-22 12:16:50 +01:00
toml fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
tools/tmpl refactor: modify tooling to take advantage of go run 2018-10-15 11:01:27 -05:00
tsdb fix(tsdb): allow backups during snapshotting, and don't leak tmp files (#20527) 2021-01-18 19:02:26 -08:00
ui chore(ui): Update flux-lsp-browser to v0.5.28 2021-01-19 17:55:25 -05:00
uuid chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
v1 fix(onboarding): don't ignore failures to set initial password (#20317) 2020-12-16 06:43:43 -08:00
vault fix: switch port to 8086 2020-09-03 14:40:29 -07:00
write chore(write): refactor batcher to reuse code 2020-10-11 13:25:57 +02:00
zap refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
.editorconfig chore(editorconfig): revert editorconfig changes, too much work 2020-06-25 18:16:57 +01:00
.gitignore chore: remove arm6 from build and add private.key to gitignore (#19748) 2020-10-14 14:02:44 -07:00
.goreleaser.yml build: rewrite our CI/CD pipeline to make ARM64 docker build work (#20484) 2021-01-11 15:01:09 -08:00
CHANGELOG.md fix(influxql): set correct Content-Type on v1 query responses (#20565) 2021-01-22 07:31:52 -08:00
CONTRIBUTING.md docs: add clarity to source build instructions 2020-12-03 11:25:59 -04:00
DEVELOPMENT.md fix: switch port to 8086 2020-09-03 14:40:29 -07:00
Dockerfile fix: switch port to 8086 2020-09-03 14:40:29 -07:00
FUZZ.md docs: Update FUZZ.md 2020-10-26 10:43:21 -07:00
LICENSE Initial commit 2018-05-09 09:17:31 -07:00
Makefile build: rewrite our CI/CD pipeline to make ARM64 docker build work (#20484) 2021-01-11 15:01:09 -08:00
README.md docs: add clarity to source build instructions 2020-12-03 11:25:59 -04:00
SECURITY.md chore: Update table of supported security updates 2020-09-28 15:19:25 -07:00
api-compat.Jenkinsfile chore(Jenkins): Update Golang build container to 1.12 2019-04-12 15:51:21 -04:00
appveyor.yml fix(tasks): Add a log message for run transition clairity (#14321) 2019-07-12 10:10:11 -06:00
auth.go refactor!: replace authorizer.Allowed method with PermissionSet (#17959) 2020-05-13 12:27:46 +01:00
authz.go fix(auth): use init to read envvar once (#19314) 2020-08-12 16:51:31 -04:00
authz_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
backup.go fix: pr review changes 2020-11-05 10:10:32 -07:00
bucket.go feat: Minor updates to backup/restore 2020-11-05 10:05:01 -07:00
build.go feat(influxdb): Add global BuildInfo 2019-03-14 09:23:53 -07:00
check.go Merge branch 'master' into chore/merge-master 2020-05-12 11:18:25 -07:00
credentials.go fix: Fixed typos in doc comments 2020-10-30 11:56:09 -07:00
crud_log.go chore(inmem): nuke the duplicative inmem store 2019-12-30 11:04:45 -08:00
dashboard.go feat(geo-widget): pkger support added 2020-12-18 19:37:08 +01:00
dashboard_test.go test: verify geo configuration serialization 2020-12-18 19:37:08 +01:00
dbrp_mapping.go fix(api): make the dbrp api match the swagger spec 2020-11-18 11:47:23 -06:00
dbrp_mapping_internal_test.go chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
dbrp_mapping_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
delete.go revert(storage): Revert changes from 1501351 2020-08-24 10:08:46 -07:00
document.go chore(documents): reinstate minimal read-only document store for dashboard templates 2020-11-16 12:41:26 +00:00
duration.go refactor(tasks): use go Time for Task CreatedAt, UpdatedAt, LatestCompleted, Offset (#15672) 2019-11-12 17:13:56 -08:00
env feat: add support for pkg-config (#17036) 2020-02-28 11:08:21 -06:00
error.go chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
errors.go feat: Add ENotImplemented error code 2020-09-24 11:11:46 -07:00
errors.md fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
errors_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
flags.yml feat(tasks): added functionality to filter runns by time 2020-11-10 10:30:34 -10:00
go.mod chore(flux): update Flux to v0.101.0 (#20554) 2021-01-21 12:30:51 -08:00
go.sum chore(flux): update Flux to v0.101.0 (#20554) 2021-01-21 12:30:51 -08:00
id.go fix: misuse of reflect.SliceHeader (#19875) 2020-11-09 09:37:20 -05:00
id_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
keyvalue_log.go feat(kv): implemented key/value store with end-to-end integration tests 2019-02-19 17:47:19 -06:00
label.go fix(labels): prevent adding duplicate labels to resources in kv (#17340) 2020-04-16 09:02:50 -07:00
label_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
lookup.go refactor(telegraf): remove references to kv service telegraf service implementation 2020-11-04 15:53:02 +00:00
measurement.go chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
notification.go refactor!(notifications): drop URM and Org services from NotificationRuleService interface definition (#18131) 2020-05-20 15:10:09 +01:00
notification_endpoint.go refactor(notifications): isolate endpoint service (#19818) 2020-10-28 15:22:14 +00:00
onboarding.go fix(build): building arm 6 (#19756) 2020-10-21 16:29:48 -07:00
operation_log.go chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
organization.go fix: org filtering for both kv and tenant need to match behaviors. (#17758) 2020-04-16 12:22:21 -06:00
paging.go fix: revert changes to API page-sizes (#20093) 2020-11-18 13:33:49 -05:00
passwords.go chore: refactor password service to provide userID instead of name 2019-11-20 09:16:31 -08:00
query.go refactor(http): remove the spec and update lang usage (#17148) 2020-03-09 13:30:43 -05:00
scraper.go fix: Allow self signed certificates to ScraperTarget (#20047) 2020-11-17 13:35:41 -05:00
secret.go feat(http): add notification endpoint service 2019-12-10 12:40:17 -08:00
secret_test.go feat(notification/endpoint): add endpoint struct 2019-08-15 21:56:17 -04:00
semaphore.go refactor: simpify Semaphore interface 2019-10-23 19:49:48 +01:00
session.go fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
source.go fix: encode IDs as JSON map keys properly 2019-04-26 20:41:20 -07:00
status.go feat(kv): add new update 2019-03-28 11:46:41 -04:00
tag.go feat(pkger): add application functionality for the notification rules resource 2019-12-20 12:48:46 -08:00
tag_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
task.go feat: upgrade Flux to v0.83.2 (#19569) 2020-09-16 17:59:15 -07:00
task_errors.go fix: don't duplicate text in task errors (#20380) 2020-12-22 12:16:50 +01:00
task_test.go refactor: replace builtin package with fluxinit/static (#3304) (#19909) 2020-11-05 16:54:28 -08:00
telegraf.go fix(telegraf): support pagination parameters when listing 2020-11-04 15:53:02 +00:00
telegraf_test.go fix: correct various typos (#19987) 2020-11-11 13:54:21 -05:00
tenant.go test: add tests for tenant service 2020-03-19 11:34:15 +01:00
token.go chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
tools.go chore(tools): remove goreleaser from the tools.go file (#18775) 2020-06-29 11:07:53 -05:00
usage.go chore: rename imports from platform to influxdb 2019-01-09 20:51:47 -08:00
user.go feat(task): Add new permission lookup pattern for executor (#18920) 2020-07-13 14:47:58 -06:00
user_resource_mapping.go feat(task): Add new permission lookup pattern for executor (#18920) 2020-07-13 14:47:58 -06:00
user_resource_mapping_test.go chore: update staticcheck and fix newly identified lint checks (#18737) 2020-06-26 18:54:09 -05:00
variable.go fix: add variable name validation for flux identifier 2020-08-21 10:28:18 -07:00
variable_test.go refactor: rewrite imports to include the /v2 suffix for version 2 2020-04-03 12:39:20 -05:00
write.go fix: add ability to define bucket to write to with a BucketFilter (#19658) 2020-10-05 15:05:49 -06:00

README.md

InfluxDB CircleCI

Slack Status

InfluxDB is an open source time series platform. This includes APIs for storing and querying data, processing it in the background for ETL or monitoring and alerting purposes, user dashboards, and visualizing and exploring the data and more. The master branch on this repo now represents the latest InfluxDB, which now includes functionality for Kapacitor (background processing) and Chronograf (the UI) all in a single binary.

The list of InfluxDB Client Libraries that are compatible with the latest version can be found in our documentation.

If you are looking for the 1.x line of releases, there are branches for each minor version as well as a master-1.x branch that will contain the code for the next 1.x release. The master-1.x working branch is here. The InfluxDB 1.x Go Client can be found here.

Installing

We have nightly and versioned Docker images, Debian packages, RPM packages, and tarballs of InfluxDB available at the InfluxData downloads page. We also provide the influx command line interface (CLI) client as a separate binary available at the same location.

If you are interested in building from source, see the building from source guide for contributors.

Getting Started

For a complete getting started guide, please see our full online documentation site.

To write and query data or use the API in any way, you'll need to first create a user, credentials, organization and bucket. Everything in InfluxDB is organized under a concept of an organization. The API is designed to be multi-tenant. Buckets represent where you store time series data. They're synonymous with what was previously in InfluxDB 1.x a database and retention policy.

The simplest way to get set up is to point your browser to http://localhost:8086 and go through the prompts.

You can also get set up from the CLI using the command influx setup:

$ bin/$(uname -s | tr '[:upper:]' '[:lower:]')/influx setup
Welcome to InfluxDB 2.0!
Please type your primary username: marty

Please type your password: 

Please type your password again: 

Please type your primary organization name.: InfluxData

Please type your primary bucket name.: telegraf

Please type your retention period in hours.
Or press ENTER for infinite.: 72


You have entered:
  Username:          marty
  Organization:      InfluxData
  Bucket:            telegraf
  Retention Period:  72 hrs
Confirm? (y/n): y

UserID                  Username        Organization    Bucket
033a3f2c5ccaa000        marty           InfluxData      Telegraf
Your token has been stored in /Users/marty/.influxdbv2/credentials

You can run this command non-interactively using the -f, --force flag if you are automating the setup. Some added flags can help:

$ bin/$(uname -s | tr '[:upper:]' '[:lower:]')/influx setup \
--username marty \
--password F1uxKapacit0r85 \
--org InfluxData \
--bucket telegraf \
--retention 168 \
--token where-were-going-we-dont-need-roads \
--force

Once setup is complete, a configuration profile is created to allow you to interact with your local InfluxDB without passing in credentials each time. You can list and manage those profiles using the influx config command.

$ bin/$(uname -s | tr '[:upper:]' '[:lower:]')/influx config
Active	Name	URL			            Org
*	    default	http://localhost:9999	InfluxData

Writing Data

Write to measurement m, with tag v=2, in bucket telegraf, which belongs to organization InfluxData:

$ bin/$(uname -s | tr '[:upper:]' '[:lower:]')/influx write --bucket telegraf --precision s "m v=2 $(date +%s)"

Since you have a default profile set up, you can omit the Organization and Token from the command.

Write the same point using curl:

curl --header "Authorization: Token $(bin/$(uname -s | tr '[:upper:]' '[:lower:]')/influx auth list --json | jq -r '.[0].token')" \
--data-raw "m v=2 $(date +%s)" \
"http://localhost:8086/api/v2/write?org=InfluxData&bucket=telegraf&precision=s"

Read that back with a simple Flux query:

$ bin/$(uname -s | tr '[:upper:]' '[:lower:]')/influx query 'from(bucket:"telegraf") |> range(start:-1h)'
Result: _result
Table: keys: [_start, _stop, _field, _measurement]
                   _start:time                      _stop:time           _field:string     _measurement:string                      _time:time                  _value:float
------------------------------  ------------------------------  ----------------------  ----------------------  ------------------------------  ----------------------------
2019-12-30T22:19:39.043918000Z  2019-12-30T23:19:39.043918000Z                       v                       m  2019-12-30T23:17:02.000000000Z                             2

Use the -r, --raw option to return the raw flux response from the query. This is useful for moving data from one instance to another as the influx write command can accept the Flux response using the --format csv option.

Introducing Flux

Flux is an MIT-licensed data scripting language (previously named IFQL) used for querying time series data from InfluxDB. The source for Flux is available on GitHub. Learn more about Flux from CTO Paul Dix's presentation.

Contributing to the Project

InfluxDB is an MIT licensed open source project and we love our community. The fastest way to get something fixed is to open a PR. Check out our contributing guide if you're interested in helping out. Also, join us on our Community Slack Workspace if you have questions or comments for our engineering teams.

CI and Static Analysis

CI

All pull requests will run through CI, which is currently hosted by Circle. Community contributors should be able to see the outcome of this process by looking at the checks on their PR. Please fix any issues to ensure a prompt review from members of the team.

The InfluxDB project is used internally in a number of proprietary InfluxData products, and as such, PRs and changes need to be tested internally. This can take some time, and is not really visible to community contributors.

Static Analysis

This project uses the following static analysis tools. Failure during the running of any of these tools results in a failed build. Generally, code must be adjusted to satisfy these tools, though there are exceptions.

  • go vet checks for Go code that should be considered incorrect.
  • go fmt checks that Go code is correctly formatted.
  • go mod tidy ensures that the source code and go.mod agree.
  • staticcheck checks for things like: unused code, code that can be simplified, code that is incorrect and code that will have performance issues.

staticcheck

If your PR fails staticcheck it is easy to dig into why it failed, and also to fix the problem. First, take a look at the error message in Circle under the staticcheck build section, e.g.,

tsdb/tsm1/encoding.gen.go:1445:24: func BooleanValues.assertOrdered is unused (U1000)
tsdb/tsm1/encoding.go:172:7: receiver name should not be an underscore, omit the name if it is unused (ST1006)

Next, go and take a look here for some clarification on the error code that you have received, e.g., U1000. The docs will tell you what's wrong, and often what you need to do to fix the issue.

Generated Code

Sometimes generated code will contain unused code or occasionally that will fail a different check. staticcheck allows for entire files to be ignored, though it's not ideal. A linter directive, in the form of a comment, must be placed within the generated file. This is problematic because it will be erased if the file is re-generated. Until a better solution comes about, below is the list of generated files that need an ignores comment. If you re-generate a file and find that staticcheck has failed, please see this list below for what you need to put back:

File Comment
query/promql/promql.go //lint:file-ignore SA6001 Ignore all unused code, it's generated

End-to-End Tests

CI also runs end-to-end tests. These test the integration between the influx server the ui. You can run them locally in two steps:

  • Start the server in "testing mode" by running make run-e2e.
  • Run the tests with make e2e.