cde973f409
refactor query engine
2016-02-10 09:40:24 -07:00
375f56333e
typo: databse -> database
...
Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2016-02-10 11:34:34 +11:00
3c1cbe0ea7
Don't dump blank entry for backup dir if not set
2016-02-09 08:13:40 -08:00
d2908def07
Make it clear what the trailing parallel factor is
2016-02-09 08:13:37 -08:00
d4ee1cb2b1
Merge pull request #5284 from mglazer/secure-cli
...
CLI Option to Connect without HTTPS Verifica…
2016-02-08 11:45:32 -07:00
c2fb3f8590
Merge pull request #5570 from jonseymour/typo
...
typo: remove trailing i.
2016-02-08 08:31:40 -07:00
0f674e5c59
typo: remove trailing i.
...
Signed-off-by: Jon Seymour <jon@wildducktheories.com>
2016-02-08 16:44:42 +11:00
978305a6dd
fix unit test of influxd in the windows
...
fix unit test of influxd in the windows
2016-02-05 11:44:14 +08:00
1c19320e79
Merge pull request #5515 from influxdata/jw-config
...
Remove top-level dir config option
2016-02-02 13:26:11 -07:00
51da6e3d56
Remove top-level dir config option
...
This breaks backup/restore if it's not "meta" as well as breaks
upgrades from prior releases for some users.
2016-02-02 13:03:44 -07:00
0864816c8b
Add unit tests to ensure retention policy for non existing db is not created
2016-02-02 21:03:16 +01:00
c3fb710871
Initialize MetaClient before setting it up as a data and/or meta node
...
Take out MetaClient initialization from initializeDataNode and invoke it
in (server.)Open after MetaService is opened.
Fixes #5479
2016-02-02 17:39:29 +01:00
b8e42cdd3a
Ensure non-interactive mode returns appropriate exit code
...
Fixes #5475 .
2016-02-02 15:23:16 +00:00
f8b1aa69a1
ignore join arguments on restart
2016-02-01 12:47:15 -05:00
834744a4c3
Merge pull request #5472 from influxdata/jl-backup-dir
...
Update influx_tsm to use a backup directory
2016-01-28 13:35:57 -05:00
8f3131b97d
Update influx_tsm to use a backup directory
2016-01-28 12:36:34 -05:00
0f6c75ab7d
make tests pass
2016-01-28 11:03:44 -06:00
53323737b2
no longer need nil check
2016-01-28 10:05:54 -06:00
d70b694d7d
fix misc meta statup bugs
2016-01-28 10:05:53 -06:00
31c2e7012a
allow for node upgrade
2016-01-28 10:05:53 -06:00
9ab5de0a34
Merge pull request #5454 from joelegasse/influx_tsm
...
TSM conversion tool improvements
2016-01-28 10:38:47 -05:00
482772997e
Updated tests for 'influx_tsm'
...
Also changed some things to fix failing tests on circleCI, and
removed old TODO item
2016-01-28 09:34:00 -05:00
716714364a
Backup node.json with metastore backup
2016-01-27 17:39:54 -07:00
908259340b
Improvements to influx_tsm
...
- Improve logging and status updates
- Added debug http endpoint
- Properly resume/skip backed up files
2016-01-27 16:13:23 -08:00
3723680747
Merge pull request #5460 from sczk/issue-5436
...
Prevent exponential growth in ~/.influx_history
2016-01-27 15:12:31 -08:00
4f89c15bd3
Replaced more log.Print();os.Exit(1) with log.Fatal()
2016-01-27 07:25:46 -08:00
40e04d89fc
Prevent exponential growth in ~/.influx_history
...
The history file is cleared before WriteHistory is called after each
command/exit() to prevent exponential file growth.
This commit addresses issue #5436 , please see PR for full explanation.
2016-01-26 20:53:41 -06:00
5abdb42a7d
Use a bounded pool for remote writes
...
Under highly conncurrent write load, the coordinating node would
create a connection to any other node that is part of the replica
group. Since each connection can be expensive, OOM sitations could
occur because there was no bounds on the number of new connections
that would be created. If writes on a remote node were slow, connections
could pile up an exacerbate the problem.
This switches the pool to be bounded and has a checkout that is blocking
with a timeout. If a connection is available, it's returned immediately.
If the pool still has room for more connections, it will create one if needed.
Otherwise, the call will block until a connection becomes available or
the timeout expires. In the case of a timeout, it is propogated back up
to the PointsWriter that determine what do return to the client.
2016-01-26 17:08:36 -07:00
cdde2959af
Limit parallelism for 'influx_tsm -parallel'
2016-01-26 09:11:09 -08:00
1696db1c40
Fixup default hostname and config
2016-01-22 17:05:25 -07:00
914a9a1de6
fix build after rebase
2016-01-21 15:38:13 -05:00
8456169855
Update backup/restore to use MetaClient
2016-01-21 15:32:35 -05:00
ef596c6b6b
skip backup/restore test until we update the code
2016-01-21 15:32:03 -05:00
15314111cb
buildable test suite
2016-01-21 15:31:27 -05:00
19c79af840
fix build break
2016-01-21 15:31:27 -05:00
177ce33b02
fix build break
2016-01-21 15:31:27 -05:00
b7e1ecf471
Close idle MetaClient http connections
...
Prevents too many open files when running tests
2016-01-21 15:30:09 -05:00
ad52d0fbd9
Fix tests
2016-01-21 15:30:09 -05:00
bbe13c2818
Ensure HTTP and TCP bind addresses have hostnames
...
If a bind-address of :8088 is used, cluster nodes cannot
connect to those nodes because there is no hostname portion
of the address. When we see a bind-address without a hostname,
use the os hostname or localhost if that fails if it is not specified
in the config already.
2016-01-21 15:28:34 -05:00
83cca53e9e
Removed references to restore from influxd's main.go, which was causing compile issues.
2016-01-21 15:28:34 -05:00
7b71b66e31
Update meta service, meta client, and httpd handler
...
* Improve the ping endpoint so that it can optionally check for leader agreement across all meta servers
* Add Ping method to the meta client
* Fix ClusterID tests
* Remove WaitForLeader from meta client and remove unnecessary references to it
2016-01-21 15:28:33 -05:00
101ab32571
Fix meta-service for server integration tests
...
* Updated CreateShardGroup to not return an error if it already exists so it's idempotent
* Removed old test making sure you can't delete the default RP. You can delete it now, there was no reason to disallow it.
* Wired up the UpdateRetentionPolicy functionality
2016-01-21 15:28:33 -05:00
68f33c93ce
Finish wiring up meta service to server
2016-01-21 15:28:33 -05:00
f385945058
Update Server to work with new metaservice/client
2016-01-21 15:28:33 -05:00
c9d82ad0ad
Wire up meta service functionality
...
* Add dir, hostname, and bind address to top level config since it applies to services other than meta
* Add enabled flags to example toml for data and meta services
* Wire up add/remove raft peers and meta servers to meta service
* Update DROP SERVER to be either DROP META SERVER or DROP DATA SERVER
* Bring over statement executor from old meta package
* Start meta service client implementation
* Update meta service test to use the client
* Wire up node ID/meta server storage information
2016-01-21 15:28:32 -05:00
9ec7a710c9
some misc refactoring on influxd startup
2016-01-21 15:28:32 -05:00
8d878fff91
buildable meta -> services/meta
2016-01-21 15:28:32 -05:00
b51c6a935f
Improve backup/restore logging and help commands
2016-01-20 13:46:14 -07:00
8791011b10
Validate metadata backup blob
...
Fixes #5349
2016-01-19 10:30:08 -08:00
dfc59e8a13
Ensure the backup directory exists.
...
Fixes #5350
2016-01-15 14:38:33 -08:00
82e16a1899
Merge pull request #5309 from influxdata/c_usage
...
Unit test scrubbing values during conversion
2016-01-07 14:59:39 -08:00
653dba3759
Merge pull request #5129 from e-dard/fix-precision-flag
...
Ensure precision flag is respected in CLI
2016-01-07 14:48:57 -08:00
16829dedc8
Merge pull request #5308 from influxdata/jw-compact-large
...
Use block size and file size before skipping a file during compactions
2016-01-07 15:48:03 -07:00
cd2de5f25d
Unit test scrubbing values during conversion
2016-01-07 14:33:42 -08:00
c6d32bd1bb
Fix #5127
2016-01-07 22:30:46 +00:00
2d2c315356
Dump points per TSM point written
2016-01-07 13:58:23 -08:00
0264d77545
Fix block sizes reported by influx_inspect
2016-01-07 14:51:59 -07:00
13d2b69c29
Dump conversion factor on completion
2016-01-07 13:50:56 -08:00
bab2a00e5d
Track bytes written by conversion tool
2016-01-07 13:50:45 -08:00
9b02808e6c
ShardInfos now returns size
2016-01-07 13:36:25 -08:00
067cc71923
Count number of fieldless points filtered
2016-01-06 11:52:42 -08:00
ff96e17ddb
Skip points without fields
2016-01-06 11:45:20 -08:00
9c916b0b76
Best-effort cleanup of converter.
2016-01-05 19:27:27 -08:00
2a547b0db3
Increment sequence, not generation
...
Avoid having all the new files getting picked up by the compaction
planner on startup.
2016-01-05 19:27:22 -08:00
fbb3e861ca
Clearer database backup message
2016-01-05 17:51:52 -08:00
075ef45ae1
Gather conversion stats
2016-01-05 16:55:22 -08:00
cac96113c0
Merge pull request #5278 from influxdata/c_fixes
...
Skip bz1 bolt files without any points
2016-01-05 19:09:49 -05:00
90292dd429
Merge pull request #5279 from influxdata/jw-compaction-memory
...
Reduce allocations during TSM compactions
2016-01-05 16:50:18 -07:00
140f54a01d
Skip bolt files without any points
2016-01-05 15:19:56 -08:00
dd90824eb5
Fix go vet in restore.go
2016-01-05 09:37:44 -07:00
d53674e2cc
Add note about new tsm1 directory permissions
...
[ci skip]
2016-01-04 15:23:05 -08:00
ed10978b71
Increase default max TSM file size
2016-01-04 13:58:43 -08:00
250c10f126
Tweak influx_tsm help output
2016-01-04 13:58:12 -08:00
8212bc82b9
Correct typo in influx_tsm help
2016-01-04 13:55:36 -08:00
c825ff7bae
Merge pull request #5203 from influxdb/js-fix-use-test-panic
...
Add a mock client to the cli test for Use
2016-01-04 13:54:03 -05:00
ee233c849a
Merge pull request #5224 from influxdb/pd-backup-restore
...
Implement backup/restore for TSM.
2015-12-31 08:56:12 -05:00
49d480cb0c
Fix races in backup/restore
2015-12-31 08:42:01 -05:00
9cede5fb71
Address PR comments
2015-12-30 18:06:51 -05:00
26e1c6464a
Update backup to address PR comments
2015-12-30 18:06:51 -05:00
59fbd371fc
Implement backup/restore for TSM.
...
This changes backup and restore to work for TSM. It breaks it for b1 and bz1, but since those are getting removed it's ok.
The backup runs against any host that is specified and can backup either the metasstore, a database, specific retention policy, or a specific shard. It can also take incremental backups with the `since` flag, which will only backup TSM files that have been created since that timestamp.
The backup is safe to run online. However, for shards that are still hot for writes, they won't be able to create new TSM files while the backup for that single shard runs. If the backup isn't too large and the write throughput isn't too high this shouldn't be a problem since the writes will just go into the WAL cache.
2015-12-30 18:06:50 -05:00
bf1673f466
Merge pull request #5239 from influxdb/md-add-db
...
Add flag to specify db and clarify flag descriptions
2015-12-30 10:59:31 -08:00
7c025d8497
Change db flag message
2015-12-29 13:12:05 -08:00
eaec514ca0
b*1 to tsm1 shard converter
2015-12-29 15:31:07 -05:00
6b546cb766
Remove calls of os.Exit from influx cli Run method and fix influx tests
...
One of the first unit tests in the cli tests called the Run method.
Since the Run method called os.Exit, it reported the unit tests as
succeeded. When parallel is set to 1, this skips _all_ unit tests after
the first one. When parallel is set to a higher value, unit tests run by
other processes still get run.
This changes the Run method to return an error (if one occurred). This
error can then be printed out and a bad exit status can be used to exit
the program from the main program instead. That causes the unit tests
to run correctly regardless of how many parallel processes are running.
Also added an additional option to the CLI called `IgnoreSignals`. If
this is set to true, then signals are not registered with the process.
Setting signals doesn't really work in unit tests so it's good to ensure
they don't get set in the first place.
In addition to fixing the influx cli tests, this adds a mock client to
the cli test for Use. PR #5183 added a validation for `use` to only be
able to select public databases so `_internal` couldn't be chosen. To
implement this, the `SHOW DATABASES` command was used by the internal
client.
Some of the unit tests in `cli_test.go` don't set the client to
anything. `TestParseCommand_Use` previously didn't, but now it needs to
have a client in the unit test with an empty test server.
2015-12-29 14:58:54 -05:00
ebd9b9978e
Add flag to specify db and clarify flag descriptions
2015-12-29 11:31:28 -08:00
c049ebfa43
Support connecting to InfluxDB with the client without HTTPS Verification
...
The V2 client code supports this, however, the V1 client code didn't,
and the argument to support this just had to be added to the CLI
2015-12-29 09:03:16 -08:00
a38c95ec85
Update compactions to run concurrently
...
This has a few changes in it (unfortuantely). The main change is to run compactions
concurrently. While implementing this, a few query and performance bugs showed up that
are also fixed by this commit.
2015-12-23 18:01:11 -07:00
767a7f5131
'broker' and 'data' are obsolete
2015-12-23 15:27:47 -05:00
2a101dc379
Add profiling flags to help output
2015-12-23 15:22:50 -05:00
26bc778b40
adding quit and Ctrl-D support to influx cli
...
update comment based on feedback
2015-12-23 11:54:41 -05:00
3165c707fc
Small improvements to USE command as per PR comments.
2015-12-22 08:55:32 +00:00
3f4949019d
USE databasename will work only for existing databases. Fixes #5174
2015-12-21 09:34:40 +00:00
4b93f6c72d
Merge pull request #5142 from influxdb/jw-tsm-migrate
...
Optimize TSM compaction
2015-12-18 10:17:34 -07:00
99f90770da
Fixed code format using go fmt.
2015-12-18 00:28:58 +11:00
33de878956
Fixed #5078 to support Inserts in non-interactive mode.
...
Changed non-interactive mode to send everything through the CLI's parser the same way the interactive mode works.
Added multiline support for -execute flag.
2015-12-17 23:42:30 +11:00
ff12e83e7f
Merge pull request #5148 from influxdb/jz-influx-stress-documentation
...
Add README.md for influx_stress
2015-12-16 17:16:22 -08:00
a507a8dd8e
Add README.md for influx_stress
2015-12-16 16:20:37 -08:00
93d93797da
Fix snappy decode error w/ influx_inspect
2015-12-16 11:28:13 -07:00
d89e233567
Merge pull request #5100 from influxdb/dgn-fix-4303
...
fix #4303 : don't drop from multiple databases
2015-12-15 07:27:05 -05:00
7d0d9b75d9
Add backoff to retry function
...
Set backoff constant
Wait to parse flags
Remove unnecessary logging
Fix retry logic
2015-12-14 13:46:40 -08:00
69f22803d2
fix #4303 : duplicate url.Values
2015-12-14 12:28:01 -05:00
3014fb90e4
fix #4303 : don't drop from multiple databases
2015-12-12 13:54:23 -05:00
718fb92cf5
Remove registration, add 'usage-client'
...
Server registration and stats reporting has been removed from what was
once http://enterprise.influxdata.com . The app that lived there, now
runs at http://usage.influxdata.com , so that the subdomain can
eventually be repurposed. Because we also want to repurpose the
`enterprise-client` repo, we have also renamed that to `usage-client`.
InfluxDB no longer needs the `registration` service now, since all of
the endpoints it communicates with simply discard the data provided to
them.
2015-12-10 15:58:34 -05:00
def5e06150
Merge pull request #5064 from mengjinglei/fix-parens-math
...
fix issue #5054
2015-12-10 08:44:48 -08:00
149b93fd4b
add a test case
2015-12-10 13:51:43 +08:00
b7000c80dd
count with fill(none) will drop 0 valued intervals
2015-12-09 15:20:47 -07:00
3a901abbd8
fix issue #5054
2015-12-09 15:27:33 +08:00
59169dcdc4
Implement WriteHTTPHandler
2015-12-08 16:09:12 -08:00
364a699416
Add broadcast channel for stress
2015-12-08 14:29:22 -08:00
40e606cb14
Merge pull request #5003 from influxdb/jw-compaction
...
Update compaction planning
2015-12-05 16:49:54 -05:00
41b24995a7
Compcation fixes
2015-12-05 12:19:28 -07:00
14b5ed3001
Merge pull request #4961 from influxdb/md-stress-cluster
...
Add cluster support to stress test
2015-12-04 15:20:31 -08:00
4f69936564
Add more math unit tests to server-level tests
2015-12-04 11:23:35 -08:00
c54a3da0ca
Implement delete series/measurement
2015-12-04 09:10:26 -07:00
477110f0b7
add option to disable logging for meta service. useful for testing
2015-12-03 11:11:36 -06:00
0c2588ed43
cluster retention auto create test
2015-12-03 08:08:57 -06:00
52da1c76d6
cluster retention policy tests
2015-12-03 08:08:56 -06:00
96c230d968
allow for configurable cluster creation
2015-12-03 08:08:56 -06:00
ab57bde115
more tests, some refactoring
2015-12-03 08:08:56 -06:00
91da96eb34
fix race in test harness
2015-12-03 08:08:56 -06:00
6e845839c8
fix flakey test harness
2015-12-03 08:08:56 -06:00
967a53cabd
start sharing integration tests for cluster tests
2015-12-03 08:08:56 -06:00
3208564192
fix RP not found error messages
2015-12-03 08:04:09 -06:00
343f00d1f2
fix go vet errors
2015-12-03 08:04:09 -06:00
76d291e88e
beginning of cluster test harness
2015-12-03 08:04:09 -06:00
f9fa366861
Add querying across cluster
...
Add support for precision
2015-12-02 14:49:23 -08:00
b0f27beb12
Add support for writing to a cluster
2015-11-30 10:22:12 -08:00
8e2868ed60
Added support for setting retention policy on database creation.
...
Fixes #2676
2015-11-27 20:02:55 +00:00
a6541937f8
Add dumptsmdev to influx_inspect
...
Allow inspecting the updated TSM format.
2015-11-24 08:50:13 -07:00
98632778dd
%s will convert a float to a less than useful string. %v is better.
2015-11-20 15:43:35 -05:00
c71e323d63
ServerID and ClusterID need to be strings when being sent to Enterprise.
2015-11-20 15:22:27 -05:00
1e9e7c2d94
Merge pull request #4807 from flisky/master
...
FIX #4279 CLI support multiline
2015-11-18 19:03:34 -08:00
c4a6490d32
Update influx_inspect to use new DecodeBlock interface
2015-11-17 23:24:09 -07:00
9a5120b2a3
Merge pull request #4742 from influxdb/md-new-stress
...
WIP: Refactor Stress tool
2015-11-17 14:42:51 -08:00
eb0e760763
Update stress config examples
2015-11-17 14:36:10 -08:00
b86c0d31d7
Refactor stress tool
...
Add StressTest type and auxillary interfaces
Add config structs
Move generator to config
Add utility methods used in stress
Add basic components for a stress test
Add touches
Add configuration options
Add unified results handlers
Add final print out of results
Add Success function to response type
Add query support
Send query results
Add comments to run.go
Change Basic to BasicWriter
Add basic query
Add incomplete README
Abstract out response handling
Change plugin to basic
Add responseHandler type
Add additional parameter to Query function
Add todo comments and cleanup main
Lower hard coded value
Add flag for profiling
Fix race condition
Wait at the right place
Chane point from struct to interface
Improve generic write throughput
Reorganize
Fastest State
Add toml config
Add test server
Add basic working version of config file
Move config file logic into its own file
Fix broken config file
Add query count to stress config
Add support for concurrency and batch interval
Reorder config option
Remove unneeded init
Remove old stress package
Move new stress code into stress directory
Rework influx_stress tool
Do something reasonable if no config is given
Remove unneeded comments
Add tests for stress package
Add comments and reorganize code
Add more comments
Count lines posted correctly
Add NewConfig method
Fix style issues
Add backticks to flag description
Fix grammar
Remove `StartTimer` calls where appropriate
Fix comment language
Change Reader to Querier
Reorder defer
Fix issues bought up by golint
Add more comments
Add more detailed Readme
Increase counter appropriately
Add return errors where appropriate
Add test coverage
Move `now()` from QueryClient to QueryGenerator
2015-11-17 12:16:31 -08:00
6309ec9a68
fix time inclusive comparison
2015-11-17 10:43:27 -06:00
824d7a1d9b
Add interface for heap to support Reverse for `order by desc`
2015-11-16 15:10:55 -06:00
2f3fc70514
FIX #4279 CLI support multiline
2015-11-16 22:59:21 +08:00
bb00645a84
Merge pull request #4768 from pires/4719-cli_history_refactor
...
CLI history skips blank lines.
2015-11-14 07:25:58 -06:00
a8fa170f29
Removed bogus comment.
2015-11-14 11:12:31 +00:00
912684b8d6
WHERE fields must be decoded during aggregates
...
This change ensures that if there are any fields in the WHERE clause of
an aggregate that are different from the fields in the SELECT clause,
that the cursors also decode those fields. Otherwise WHERE clauses of
the form 'SELECT f(w) FROM x WHERE y=z' will return incorrect results
Fixes issue #4701 .
2015-11-13 15:18:54 -08:00
172cc43732
Merge pull request #4766 from aneshas/cli-help-contrib
...
Changed help command output from inside the cli
2015-11-13 11:17:18 -08:00
aa6ec0cc6f
Added more tests to increase coverage. Refs #2313
2015-11-13 11:38:35 +00:00
95ced0bcc1
Changed help command output from inside the cli to
...
match the info provided by the influx --help output,
and added history command
Reverted description for pretty command
+ minor edits
Removed duplication of command names
Signed-off-by: Anes Hasicic <anes.hasicic@gmail.com>
2015-11-13 09:41:51 +01:00
eebf157171
Remove incorrect count() tests
2015-11-12 19:08:44 -08:00
f889ac1140
If no points to count, count is 0
...
Fix issue #4701 .
2015-11-12 18:52:58 -08:00
81658de1be
Exit gracefully on forced CLI termination.
2015-11-12 23:14:36 +00:00
dc609b06fd
Set GOMAXPROCS before log message
...
Previously the impression was being given that GOMAXPROCS was not being
set correctly.
2015-11-12 13:28:35 -08:00
c812aaa36b
Refactored command parsing tokenization.
2015-11-12 20:52:41 +00:00
194b2c4965
CLI history skips blank lines.
...
Fixes #4719
2015-11-12 20:50:23 +00:00
3cab8fac02
Revert to Go 1.4.2
...
This is not passing 'go vet' under 1.4.2.
2015-11-11 15:48:37 -08:00
bc1091ec31
Revert "Merge pull request #4684 from nkatsaros/default-config"
...
This reverts commit 87441584f3a14829bc1d
2015-11-11 09:29:06 -08:00
b908cbb866
fix lint errors for cmd/...
...
corrects the initialize package comment for lint
brings c.ServerVersion back
2015-11-10 23:13:01 -08:00
6ecb62e4d2
Merge pull request #4737 from ch33hau/4283-hh-throws-error-even-if-disabled
...
Disable HintedHandoff if configuration is not set. #4283
2015-11-10 19:07:27 -06:00
8bfdfbda0b
Disable HintedHandoff if configuration is not set. #4283
2015-11-11 01:12:34 +08:00
aa6f807dfe
Move CLI stuff out of main package for increased testability. Refs #2313
2015-11-10 16:27:13 +00:00
4a1dff865c
Added tests related to #4704
2015-11-09 23:58:13 +00:00
39f9e516c6
Improve CLI command parsing. Fixes #4544
2015-11-09 23:56:30 +00:00
21ddb07b5f
Merge pull request #4715 from oiooj/master
...
raft.raftLayer already closed in raft.NetworkTransport.Close()
2015-11-09 15:43:01 -08:00
fbfa175098
Merge pull request #4702 from pires/4628-cli_history
...
Implement CLI history command
2015-11-09 14:36:04 -08:00
6e9b210e63
raft.raftLayer already closed in raft.NetworkTransport.Close()
2015-11-10 00:09:19 +08:00
b41131643d
Implement CLI history command. Fixes #4628
2015-11-06 22:20:28 -05:00
2235dcec6b
Added IF EXISTS for DROP DATABASE command, #4659
2015-11-07 10:57:49 +08:00
8ac958f8a0
Merge pull request #4683 from influxdb/enterprise-client
...
Updated to use the new Enterprise Client
2015-11-06 13:13:15 -05:00
d46bf535b2
Report anonymous stats to Enterprise
2015-11-06 10:30:57 -05:00
a9e22dad5c
Merge pull request #4674 from simcap/master
...
Fix restore panic issue #4671
2015-11-06 00:19:51 -08:00
87441584f3
Merge pull request #4684 from nkatsaros/default-config
...
Add graphite and udp services to the default config generator
2015-11-05 17:53:15 -08:00
1719a6107c
PointsWriter will drop writes to subscriber service for any in-flight writes
2015-11-05 16:25:00 -07:00
4f8b0aca9a
Add graphite and udp services to the default config generator
2015-11-05 16:42:21 -05:00
c9c68e8cd3
Fix restore panics #4671
...
When unpacking the meta, the Store `Addr` is built
against the hostname and the `bind-address` port.
We can use this resolved address for the `RemoteAddr`
as well since according to the clustering docs the
`hostname must be resolved by all members in the cluster`
2015-11-05 18:31:04 +01:00
ae8b458d9e
Merge pull request #4644 from influxdb/cli_auth_panic
...
Check for errors in response during token check
2015-11-03 08:08:23 -08:00
e6dffd12c7
Check for errors in response during token check
...
Fixes issue #4641 .
2015-11-03 07:59:37 -08:00
dafc6fff42
Fix restore functionality panics
2015-11-03 19:25:33 +08:00
7508a2a252
Merge pull request #4587 from influxdb/jw-nan
...
Prevent NaN float values from being stored
2015-10-28 09:28:04 -06:00
d8e4655e0f
Merge pull request #4586 from influxdb/engine_fail_msg
...
Exit when invalid engine is selected
2015-10-27 21:50:01 -07:00
00b2454c53
Exit if invalid engine is selected
...
Fix #4584 , related to #4583
2015-10-27 17:29:18 -07:00
a727a8dd3f
Only display Enterprise hint on CLI mode
...
This change moves the logic to detect and display the Enterprise
registration hint into the same logic check as that which decides if the
successful-connection message should be displayed.
Fixes #4514 .
2015-10-27 17:18:18 -07:00
7d6d23e661
Write as many points as we can parse via line protocol
...
This changes the HTTP line protocol handler to behave similar to the other
handler in that they will write as many points as possible. Previously, we
would fail the entire batch if one point failed. This can happen more frequently
now with NaN being more explicitly unsupported. Now it will write as many points
that parse successfully and return a "partial write" error to the client with the
lines that failed to parse.
2015-10-27 17:12:57 -06:00
f703f58d22
Add HH diagnostics
2015-10-26 18:59:58 -07:00
ff4209436f
close raftState before waiting
2015-10-23 14:48:32 -06:00
90beaee803
silence subscriber service logging during testing
2015-10-23 14:48:32 -06:00
e9d303531e
reuse tsm1 decode buffer
...
This commit changes `tsm1.DecodeBlock()` to reuse the same
slice of `[]tsm1.Value` instead of reallocating a new one each time.
2015-10-23 12:51:55 -06:00
f47634ec30
Merge pull request #4540 from influxdb/md-cleanup
...
Remove unneeded lines
2015-10-23 10:12:00 -07:00
28b585e639
refactor tsdb query engine
...
This commit refactors the tsdb query engine to use separate aggregate
and raw execution paths, encapsulates cursor functionality, and removes
the TagSetCursor from the aggregate path. By removing the TagSetCursor,
we can pass sets of unordered values to the map functions and bypass
the `container/heap` entirely.
2015-10-22 09:41:12 -06:00
0035b79a84
Remove unneeded lines
2015-10-21 19:26:58 -07:00
bb80bf5211
Display Enterprise message if no token set
2015-10-20 12:59:22 -07:00
956efaeb94
Merge pull request #4506 from influxdb/enterprise_stats
...
Enterprise registration as a service
2015-10-20 08:57:19 -07:00
a3d127f797
Revert "add RENAME DATABASE"
...
This reverts commit 7212bfce83
2015-10-20 09:01:34 -04:00
307d51dad5
Revert "add integration test for RENAME DATABASE"
...
This reverts commit d2afd881e6
2015-10-20 08:43:57 -04:00
20929c3db2
Revert "change syntax to ALTER DATABASE ... RENAME TO ..."
...
This reverts commit 668b5b9bfb
2015-10-20 08:43:45 -04:00
73a0c0a247
Revert "return error when database rename conflicts with continuous queries"
...
This reverts commit 60d298936e
2015-10-20 08:39:03 -04:00
878663e1e3
Periodic upload of stats to Enterprise
2015-10-19 15:25:07 -07:00
667ad3342a
Refactor registration as a service
...
Registration also involves statistics and diagnostics upload, for the
purposes of remote management. This means there will be long-running
goroutines in effect. Therefore move the code to a service model.
2015-10-19 15:01:14 -07:00
efea0edb82
Merge pull request #4504 from influxdb/jw-4444
...
Fix panic: runtime error: index out of range - Values.MinTime
2015-10-19 13:44:28 -06:00
a268ba6bb4
feat #3523 : add unit test for no matches
2015-10-19 14:40:06 -04:00
1bcd8dd5de
Handle reading partially written tsm files better
...
If a tsm file was partially written, we were not able to read the
raw block data because we panic/exited when reading the corrupted
index. This allows us to read the raw blocks if we can.
2015-10-19 12:03:12 -06:00
401447cbed
feat #3523 : filter SHOW MEASUREMENTS by WITH
2015-10-19 14:00:53 -04:00
e73c37088f
Merge pull request #4454 from influxdb/intofixes
...
Intofixes
2015-10-19 18:58:42 +01:00
456a9a8ab7
Fix typos.
...
* meaining --> meaning
* communcation --> communication
* deterimine --> determine
* mistmatch --> mistmatch
2015-10-17 07:50:45 -07:00
026611aea9
fix #4475 : update unit test for new error message
2015-10-16 10:50:35 -04:00
a2102e19ba
always return time, never strings. fixes #4415
2015-10-15 20:19:58 -05:00
64bf96e007
100B_STD should actually write 100B points
...
[ci skip]
2015-10-15 16:54:29 -07:00
81390db622
Actually check connection errors
...
Fix issue #4463
2015-10-15 15:07:18 -07:00
42995ea326
Merge pull request #4459 from influxdb/add_token
...
Register with Enterprise server
2015-10-15 14:01:08 -07:00
8f16a85cd2
Fixed issue sending JSON numbers to Enterprise when it wants strings
2015-10-15 16:51:48 -04:00
0f001a6d9a
Handle registration errors from Enterprise server
2015-10-15 13:48:23 -07:00
07db774423
Register with Enterprise if token available
2015-10-15 13:13:34 -07:00
a7e841f447
Add config support for Enterprise token
2015-10-15 13:02:16 -07:00
ae925625ce
Merge pull request #4451 from influxdb/jw-int64
...
Int64 encoding enhancements
2015-10-15 13:44:55 -06:00
b19fbec093
Merge pull request #4445 from influxdb/jw-tsm
...
Add influx_inspect filtering support
2015-10-15 11:16:33 -06:00
cb1aaa8e42
Merge pull request #4375 from influxdb/subscriptions
...
Feature add subscriber service for creating/dropping subscriptions
2015-10-15 09:17:26 -06:00
d990b5f28d
fix into queries when encountering nil values.
...
For aggregate queries, having a null result means that you haven't
got any data for that time period. CQs used this as a signal that
the measurement was not created and dropped the entire write.
INTO queries can have any structure, including wildcards, so dropping
the entire query isn't going to work. Instead, just drop the nulls
returned.
2015-10-15 12:12:40 +00:00
30364aa2b0
Remove dead code
2015-10-14 19:26:46 -06:00
d3691425e0
Update influx_inspect to show RLE for int64 blocks
2015-10-14 19:24:04 -06:00
7870b84f20
Merge pull request #4450 from influxdb/md-flags-override
...
Flags overwriting config file
2015-10-14 16:19:46 -07:00
359f50ff85
Add support for flags overwriting config file
...
Previously the test file would over write any flags passed to
influx_stress, now flags overwrite config file options
Ammended with nit fixes
2015-10-14 16:14:20 -07:00
82f104a8b1
Merge pull request #4436 from influxdb/tag-names-to-keys
...
WIP tag name --> tag key, field name --> field key
2015-10-14 16:02:46 -07:00
8b31007aa7
Adds subscriber service for creating/dropping subscriptions to the
...
InfluxDB data stream.
2015-10-14 15:23:45 -06:00
f298e88b39
Auto-create UDP service database
...
All other services operate like this, so make UDP service consistent.
2015-10-14 08:30:09 -07:00
214e451af5
Move info command to separate file
2015-10-14 09:27:24 -06:00
4e9e3a4763
Shorten dumptsm flags
2015-10-14 09:24:54 -06:00
6d188d9703
Merge pull request #4409 from influxdb/intoq
...
wire up INTO queries.
2015-10-14 15:29:54 +01:00
48223a90f9
Fix spelling nit.
...
Make it obvious that INTO is a keyword and not part of the sentence
2015-10-14 15:16:27 +01:00
bbe0eb49bc
Add ability to filter index and block by key string match
2015-10-13 18:16:16 -06:00
8e65f0c84f
Update server_test.go
2015-10-13 16:53:10 -07:00
9a9e04084f
Update config.go
2015-10-13 16:49:09 -07:00
467ada073a
Add flags for dumping only index, block or all data
2015-10-13 17:47:37 -06:00
1a3f8c403e
Re-work influx_inspect command-line options to use sub-commands
...
Should make adding new functionality easier.
2015-10-13 17:26:23 -06:00
ad35dcea38
Handle case where IDs file is out of sync with tsm1 file or missing
...
Avoids a panic if a series ID exists in the tsm file but not in the IDs file.
Also handles the case were we don't have an ids file and just a tsm file.
2015-10-13 17:19:59 -06:00
822af73f88
implement continuous queries as regular execs of into queries.
...
Now that we have into queries, we can implement them as regular
queries that are just run on a timer.
2015-10-13 15:51:19 +00:00
62dff895e2
wire up INTO queries.
...
Since INTO queries need to have absolute information about the database
to work, we need to create a loopback interface back to the cluster
in order to perform them.
2015-10-13 15:00:36 +00:00
6787525912
fixes multiple selectors overwriting each other. fixes #4360
2015-10-12 21:40:57 -05:00
16b3084ca9
Merge pull request #4397 from influxdb/jw-tsmdump
...
tsm1 file dump
2015-10-12 08:12:23 -06:00
f58c283d8a
Add some comments
2015-10-09 22:53:58 -06:00
bc6d677b06
Add tsm file dump support to influx_inspect
...
This will read a tsm file and dump index, block and compression level info from the file.
It reads the file directly as opposed to reading it through the tsm engine which should
help with debugging and troubleshooting data file issues.
The implementation is not pretty but the output is very useful. In the future, we can
add data extraction, recovery and verification functionality if needed.
2015-10-09 22:32:11 -06:00
512d6ac050
fix #4280 : only drop points matching WHERE clause
2015-10-09 18:34:32 -04:00
455191d784
Merge pull request #4386 from influxdb/rename_inspect
...
Rename 'inspect' to 'influx_inspect'
2015-10-09 11:10:53 -07:00
1e7a86aa61
Rename 'inspect' to 'influx_inspect'
2015-10-09 11:03:39 -07:00
60d298936e
return error when database rename conflicts with continuous queries
2015-10-09 13:57:02 -04:00
668b5b9bfb
change syntax to ALTER DATABASE ... RENAME TO ...
2015-10-09 13:56:23 -04:00
d2afd881e6
add integration test for RENAME DATABASE
2015-10-09 13:55:38 -04:00
7212bfce83
add RENAME DATABASE
2015-10-09 13:55:38 -04:00
5b0a8ed306
HH should not process dropped nodes
2015-10-08 18:23:12 -07:00
26f6d00668
Bugfix for #3429 String representations of RegexLiterals generated in influxql/ast.go add the / char as a start and end delimiter, but does not escape any / characters that may exist with the regex
2015-10-08 19:41:36 +10:00
897a5effff
Merge pull request #4329 from influxdb/md-stress-timestamps
...
Add support for evenly spaced timestamps
2015-10-06 16:26:08 -07:00
4375545064
fix #4276 : walk DropSeriesStatement
2015-10-05 19:56:30 -04:00
02349a63d5
Change precison on example
2015-10-05 12:29:58 -07:00
70c7d1c4d8
Change file names to be more semantic
2015-10-05 12:29:11 -07:00
2ca11072e8
Change `jitter` to false in examples
2015-10-05 12:19:59 -07:00
52b7e557c1
Add support for timestamp jitter
2015-10-05 12:09:08 -07:00
68c1d05ad4
First pass at adding timestamps
2015-10-02 16:05:06 -07:00
d74e0690c7
Revert "Merge pull request #4233 from influxdb/drop-server"
...
This reverts commit 0bdb36f6dc3085fbc138
2015-10-02 08:39:57 -07:00
99da67007d
no more shutdown
2015-10-01 15:39:15 -05:00
73372ed907
[Ee]xecuteShutdown -> [Mm]onitorShutdown
2015-10-01 15:39:15 -05:00
34bfb6b330
be sure to exit the go routine if we terminate normally
2015-10-01 15:39:15 -05:00
7a3e1f6b27
removing peer wip
2015-10-01 15:39:15 -05:00
027da3dbb4
Add examples folder
2015-09-30 15:55:09 -07:00
f056753afe
Add moderate burn test
...
First pass at constructing points myself
2015-09-30 15:55:07 -07:00
d6027071d2
Add optional jitter to timestamps
2015-09-30 15:55:07 -07:00
293fad1e20
Add note about buffer time and change example_2
2015-09-30 15:55:07 -07:00
8a76e7db78
Add comments and tests
2015-09-30 15:55:07 -07:00
ee9c78735e
Add configurable channel buffer size
2015-09-30 15:55:07 -07:00
ecb9bd9592
Add support for stress test under query load
2015-09-30 15:55:07 -07:00
2465dbc788
Add high performance stress test example
...
First round at adding query load
Working draft:
Not happy with things, but it works
2015-09-30 15:55:07 -07:00
22a6f79a3c
Add support for `tag_count` config option
...
It is now possible to configure arbitrarily many tags in a generic
format. That is specifying the config option `tag_count=10` will add 10
tags to a series that are of the form `tag-key-n=tag-value` where n
ranges from 0 to 9.
Save current state
2015-09-30 15:55:06 -07:00
03f291d78c
Add comments and shuffle var declarations
2015-09-30 15:55:06 -07:00
fdfb039a44
Allow configuration via config file or flags
...
Note that config file takes precedence to flags
2015-09-30 15:55:06 -07:00
4e587b4622
Add comment to example toml file
2015-09-30 15:55:06 -07:00
48dde6b16c
Add support for config file
2015-09-30 15:55:06 -07:00
911623f5f6
Add quick notes
2015-09-30 15:55:06 -07:00
e608e9b79b
Add stress
...
First pass at running stress test from a toml
2015-09-30 15:55:06 -07:00
e43b60b8e1
Add example config for stress test
2015-09-30 15:55:06 -07:00
343dd23ee7
refactor map functions to use list of values
...
This commit changes `tsdb.mapFunc` to use `tsdb.MapInput` instead
of an iterator. This will make it easier and faster to pass blocks
of values from the new storage engine into the engine.
2015-09-29 14:00:33 -06:00
7cb8c2d2ec
Add build timestamp to version data
2015-09-24 23:40:53 -07:00
b1becfbcfc
more tests, simplify mapFunc signatures
2015-09-23 09:27:19 -05:00
78bc740434
full support for min/max/first/last
2015-09-23 09:03:57 -05:00
8e27cf1fd8
Merge remote-tracking branch 'upstream/master' into refactor-select-mapper
...
Conflicts:
tsdb/store.go
2015-09-22 13:58:24 -06:00
96715d7d90
rename Cursor.Seek() to Cursor.SeekTo()
2015-09-22 13:23:16 -06:00
56cb2fae5d
fix integration tests
2015-09-22 13:10:13 -06:00
649663ca15
fix tests
2015-09-22 13:10:13 -06:00
a5269e9cc7
rename direction to ascending.
2015-09-22 13:09:26 -06:00
8bd2408320
convert SHOW TAG KEYS to distributed query
2015-09-21 11:30:51 -04:00
72f6f7d268
Merge pull request #4134 from influxdb/issue-3447
...
Refactor Points and Rows to dedicated packages
2015-09-17 15:27:48 -05:00
f73bc6ff19
Merge pull request #4140 from influxdb/engine_config
...
Make engine configurable
2015-09-16 21:17:43 -07:00
7b1a4e6700
Control whether each query should be logged
...
Fixes issue #4138
2015-09-16 19:26:23 -07:00
e4fde993f1
Make engine configurable
2015-09-16 19:09:25 -07:00
d19a510ad2
refactor Points and Rows to dedicated packages
2015-09-16 15:33:08 -05:00
bf955c7c11
Merge pull request #4112 from influxdb/issue-3457
...
Period in field name that matches measurement fails. Fixes #3457
2015-09-16 09:55:43 -05:00
afe5cc67f4
Repeat the identical time aggregate test more;
2015-09-15 16:22:25 -07:00
f02d8eef4f
unskip test
2015-09-15 16:36:11 -05:00
5395ac7634
Period in field name that matches measurement fails. Fixes #3457
2015-09-15 16:26:39 -05:00
c70b503f00
go fmt
2015-09-15 16:09:58 -05:00
69c9f28e2d
Fix compilation error in test code
2015-09-15 11:42:58 -07:00
76e3552a95
Increase write-timeout to 30s during testing
...
This should hopefully reduce the rate of CI failures during testing.
2015-09-15 11:35:21 -07:00
05b2e4985f
Merge pull request #4065 from sbouchex/cmd_add_precision
...
Added precision support in cmd client
2015-09-14 16:44:23 -07:00
f623701e79
Merge branch 'master' into md-stress-runner
2015-09-11 15:45:11 -07:00
d85c4f7699
Cherry pick failed requests from 2d67a9e
...
Commit 2d67a9ea22
2015-09-11 15:10:15 -07:00
5656ba167f
Added precision support in cmd client
2015-09-11 10:04:18 +02:00
9831ab2cc8
Added precision support in cmd client
2015-09-11 09:20:02 +02:00
Ben Johnson
Jon Seymour
Philip O'Toole
Jason Wilder
runner.mei
Jason Wilder
Seif Lotfy
Edward Robinson
Cory LaNou
joelegasse
Todd Persen
Adam Svoboda
David Norton
Ross McDonald
Paul Dix
Philip O'Toole
Edd Robinson
Jonathan A. Sternberg
Michael Desa
Jonathan A. Sternberg
Mike Glazer
Sebastian Borza
Paulo Pires
nick.grange
Jack Zampolin
Tim Raymond
mengjingleli
Nathaniel Cook
Mark Bates
Yin Jifeng
Anes Hasicic
Pablo Miranda
ch33hau
oiooj
Nicholas Katsaros
simcap
Daniel Morsing
Charles Chan
Nathaniel Cook
Daniel Morsing
Sean Beckett
linearb
Nick Dawbarn
Sébastien Bouchex Bellomié