Commit Graph

2343 Commits (b1e6184ea14b9a68493bcbecbdc78d8ac44a9fd1)

Author SHA1 Message Date
Paul Dix eaaa3228bf Update CHANGELOG.md
Mark 0.8.0-rc.4 released.
2014-07-30 14:37:16 -04:00
John Shahid 72fccdab6f Don't emit non existent fields when joining
Points in the joined series should have either the columns of the left
side or the columns of the right side of the join. Before this patch
join relied on merge to order the points of the two series and then join
consecutive points together. The merge emitted the union of the columns
of the two series, which caused the joined series to always have the
union of two series. This combined with the fact that the point's values
weren't adjusted to have nulls for the missing columns caused panic when
any operation is done on the points, e.g. addition.

Fix #740, Fix #781
2014-07-30 14:06:47 -04:00
John Shahid 3ebf536737 wait for servers to sync 2014-07-29 14:29:19 -04:00
John Shahid 22cb673771 Fix the build on go1.3
There was one remaining reference to an incomplete struct type from c
which is value_array. The error printed by the compiler is intermittent,
meaning it compiles sometimes and print the error sometimes. Also,
value_array isn't strictly an incomplete data type since it contains a
pointer to an unknown data type but it's size could be computed.
2014-07-29 12:55:52 -04:00
John Shahid e8f750305f use camel casing instead of underscore 2014-07-29 12:21:48 -04:00
John Shahid 67f9869b82 revert previous commit 2014-07-28 18:12:34 -04:00
John Shahid 99ac385e6c speed up the release 2014-07-28 18:06:49 -04:00
John Shahid d18359a716 update the changelog 2014-07-28 14:44:36 -04:00
Dieter Plaetinck 856a94cc78 graphite ingest write data in batches to coordinator
Close #644

This commit also include lots of cleanup related to start up and
shutting down as well as logging. Below is an explanation of how the api
starts up and shuts down. It also covers the error conditions and how
they are handled.

networking/goroutine fixes

* break from TCP Accept() loop when connection closed, which was preventing shutdown to proceed
* make sure that UDP functionality doesn't write to writeSeries channel after it has been closed.
* clearer, more specific shutdown message

in particular:

 * self.writers allows us to make sure things writing to writeSeries are done
   (they do blocking calls to handleMessage()) whether udp or tcp
 * self.connClosed lets us break from the Accept() loop,
   see http://zhen.org/blog/graceful-shutdown-of-go-net-dot-listeners/ (quit channel)
 * shutdown channel is now allCommitted

things can get a little complicated, so here's a little schematic of how the functions and
their logic relate:
indent for a call out or important code within. everything shown as one nested tree

  server.go
      go ListenAndServe
          go committer
              reads from self.writeSeries until closed, then writes to self.allCommitted
          Serve
              for {
                  Accept, breaks if err + connClosed
                  self.writers.Add()
                  go handleClient
                      for {
                          handleMessage
                              reads until err and writes to self.writeSeries until read failed
                          reads until EOF, ignores other handleMessage errors
                      }
                      conn.Close()
                      self.writers.Done()
              }
              self.writers.Wait()
              close(self.writeSeries)
      Close()
          close(self.connClosed)
          self.conn.Close()
          wants confirmation on allCommitted channel; [timeout] returns within 5s
2014-07-28 14:40:21 -04:00
John Shahid 3284662b35 Fix an integration test that has changed in 91078c0
Non admin database users shouldn't be able to drop series. See #736 for
more details
2014-07-23 12:00:18 -04:00
John Shahid e349e22d42 Fix a unit test that has changed in 91078c0
Non admin database users shouldn't be able to drop series. See #736 for
more details
2014-07-22 15:54:16 -04:00
John Shahid e196277309 Merge branch 'pr-738'
Close #738. Fix #713
2014-07-22 15:28:02 -04:00
John Shahid 673a12257b Dry the fill() tests 2014-07-22 15:26:17 -04:00
Philip O'Toole c1e285383b Allow 'null' to be supplied as fill value
Add to unit tests to test fill, including new "null" support.

Fix #713.
2014-07-22 15:07:11 -04:00
John Shahid 91078c0d21 Non admin database users shouldn't be able to drop series
Fix #736
2014-07-22 13:33:51 -04:00
John Shahid b051ffccac add a flag to force output to go to stdout 2014-07-22 12:49:31 -04:00
John Shahid f1f575dd9a Fix travis 2014-07-22 12:31:35 -04:00
John Shahid c02cff22c5 Fix some bugs with retention policy of shard spaces
This commit fixes two bugs:

Don't try to parse "inf" retention policy when creating a shard
space. This caused a panic to be thrown when a shard space is created
with infinity. Fix #774

`getExpiredShards()` used shard duration to determine which shards are
expired but should be using shard retention duration instead. Close #769
2014-07-22 10:55:39 -04:00
John Shahid 3b710fdc10 update the changelog 2014-07-21 17:42:07 -04:00
John Shahid afe3f9607b Add the sentinel values for all db on creation
Fix #772
2014-07-21 13:36:08 -04:00
John Shahid 6dfc2b3483 Add String() to the Field structure 2014-07-21 13:26:11 -04:00
John Shahid 588e053e22 Merge pull request #766 from shugo/database_conf_fix
fix typo in integration/database_conf.json
2014-07-18 11:38:17 -04:00
John Shahid 5d4e2bbfc3 Fix the name of the config files in the integration test suite
Close #764
2014-07-18 11:37:11 -04:00
John Shahid 492fe309c8 Use goroot to find go and gofmt
Fix #752
2014-07-18 11:33:35 -04:00
Shugo Maeda 87a68beb59 fix typo in integration/database_conf.json. 2014-07-18 11:09:19 +09:00
John Shahid b4d524a6b0 Fix the test to use client.ShardSpace 2014-07-17 14:57:37 -04:00
John Shahid 5b9ab3463d fixup! use the client library without alias 2014-07-17 14:52:07 -04:00
John Shahid cfde05dbd1 Add New() to the client library so users can do client.New() 2014-07-17 14:50:01 -04:00
John Shahid 8728b2555c use the client library without alias 2014-07-17 14:49:28 -04:00
John Shahid f6ae65d134 Fix the package name of the client package 2014-07-17 14:49:07 -04:00
John Shahid fd45c9255b Remove more indirect references to the protocol package
Fix #756
2014-07-17 14:23:23 -04:00
John Shahid e4c25d06bd Revert "alias SerializedSeries"
This reverts commit 75269682ff.

Fix #756. We can't import common which in turn import protocol since
protocol contains generated files that aren't checked in the repo. Until
we have a better solution, i'll just revert this commit.
2014-07-17 14:08:44 -04:00
John Shahid 5e1b7ea357 update the changelog 2014-07-17 13:50:05 -04:00
John Shahid 1e9e2152ed Do the check in one go 2014-07-17 13:46:47 -04:00
John Shahid 7b0fffeaa7 Merge remote-tracking branch 'refs/remotes/origin/pr/760' 2014-07-17 13:21:05 -04:00
John Shahid 05a9356ba1 Merge remote-tracking branch 'refs/remotes/origin/pr/759' 2014-07-17 13:20:59 -04:00
John Shahid 13514dc6d9 more stuff in the contributing doc 2014-07-17 12:49:45 -04:00
John Shahid 8511f401dd Add some links to Go related posts 2014-07-17 12:36:16 -04:00
John Shahid 07363e8e05 remove devtools since we don't need it anymore 2014-07-17 12:36:16 -04:00
John Shahid ab4258144b Merge pull request #758 from otoolep/better_graphite_errors
Make it crystal clear why graphite fails to start
2014-07-17 10:35:40 -04:00
Shugo Maeda d74e71ca83 When a server is removed, its ID should be removed from shards. 2014-07-17 18:28:06 +09:00
Shugo Maeda 8646cb5a42 The attributes of a shard space should not be reverted to the defalut values when writing data into the shard space. 2014-07-17 14:13:15 +09:00
Philip O'Toole 01d47628d3 Set upper limit for UDP server 2014-07-16 20:51:34 -07:00
Philip O'Toole 4271c47def Make it crystal clear why graphite fails to start 2014-07-16 20:50:45 -07:00
Your Name 1f180dcca5 fix the build on centos to use recent rocksdb and statically link stdc++ 2014-07-15 20:50:33 -04:00
John Shahid 744edc5c2d don't die if clock_gettime can't be found 2014-07-15 17:32:32 -04:00
Paul Dix 4207442033 Uh, fix caps on contributing... 2014-07-15 16:01:33 -04:00
John Shahid df7e4d2b92 fix the client test 2014-07-15 15:56:17 -04:00
John Shahid aeb21aadd8 check if -lrt is needed for clock_gettime 2014-07-15 15:48:06 -04:00
John Shahid 6c5870e187 update the changelog 2014-07-15 15:38:52 -04:00