Commit Graph

2993 Commits (7f4b181c67d10f132097cfadf373c0fd5b9e8a4d)

Author SHA1 Message Date
kodiakhq[bot] 7f4b181c67
Merge pull request #1552 from influxdata/jemalloc-config
feat: log jemalloc build conf
2021-05-25 08:38:09 +00:00
kodiakhq[bot] 3f8db50e04
Merge branch 'main' into jemalloc-config 2021-05-25 08:32:56 +00:00
kodiakhq[bot] 4a94963a4e
Merge pull request #1553 from influxdata/jemalloc-features
feat: Use jemalloc everywhere instead of malloc
2021-05-25 08:32:17 +00:00
Marko Mikulicic 0a37cb80f7
feat: Use jemalloc everywhere instead of malloc
There may be many reasons for the discrepancy in jemalloc reported allocations total sizes and RSS.
One of them is that our binary doesn't use jmalloc for all the allocations.

Turns out that jemallocator only sets the global rust allocator. Any call to `malloc` will still
go throught the system allocator. Presumably those calls come from linked C code,
but it's also not impossible that not all rust code honours the global allocator (I have no idea, but let's see)
2021-05-25 03:42:52 +02:00
Marko Mikulicic 7939d1f027
feat: log jemalloc build conf 2021-05-25 03:30:18 +02:00
kodiakhq[bot] 2af6cb78fb
Merge pull request #1550 from influxdata/tran/pushdown_parquet
feat: support predicate pushdown for parquet files
2021-05-24 21:29:56 +00:00
Nga Tran 018e1e0246 chore: add a comment to trick github to check semantic 2021-05-24 17:25:14 -04:00
Nga Tran 40a5d7d4ba chore: Merge branch 'main' into tran/pushdown_parquet 2021-05-24 16:31:06 -04:00
Nga Tran e72ae81a8e feat: support predicate pushdown for parquet files 2021-05-24 16:22:52 -04:00
kodiakhq[bot] 9dfc653bac
Merge pull request #1548 from influxdata/er/refactor/scalar_comp
feat: teach Read Buffer to compare literals of different integer types
2021-05-24 17:07:37 +00:00
kodiakhq[bot] db96286ed7
Merge branch 'main' into er/refactor/scalar_comp 2021-05-24 17:02:14 +00:00
Andrew Lamb c464ffadad
refactor: remove special case timestamp_range in parquet chunk (#1543)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-24 16:19:44 +00:00
Andrew Lamb 14ba25f86d
chore: Update datafusion and use released version of arrow crates (#1546)
* chore: Update datafusion and use released version of arrow crate

* fix: Update for change in API
2021-05-24 15:37:22 +00:00
Edd Robinson eace6c9201 fix: ensure scalars compare correctly 2021-05-24 16:19:28 +01:00
Edd Robinson abe64c6edc test: uncomment tests to fix 2021-05-24 16:18:53 +01:00
Carol (Nichols || Goulding) 5c5064bdac
fix: Set default line timestamp and default partition time to same value (#1512)
* refactor: Rearrange to allow injection of the current time in tests

* test: Failing test showing a point can be in the wrong partition

* fix: Only get the default time once per ShardedEntry creation, in router
2021-05-24 14:55:11 +00:00
Andrew Lamb 27e5b8fabf
refactor: Remove multiple table support from Parquet Chunk (#1541) 2021-05-24 08:40:31 -04:00
Andrew Lamb ee06ca4c7d
refactor: remove MutableChunk::has_table (#1539)
Co-authored-by: kodiakhq[bot] <49736102+kodiakhq[bot]@users.noreply.github.com>
2021-05-22 12:02:42 +00:00
kodiakhq[bot] baef2941d8
Merge pull request #1527 from influxdata/ntran/predicate_pushdown
feat: Part 1 of predicate push down - Send predicates to RUB
2021-05-21 21:53:57 +00:00
Nga Tran 1f70d1f9c8 chore: remove a couple more comments 2021-05-21 17:06:53 -04:00
Nga Tran 0563005aac chore: remove leftover comments 2021-05-21 17:01:49 -04:00
Nga Tran f113abacb5 feat: more unit & e2e tests plus cleanup and addressing review comments of Andrew and Edd 2021-05-21 16:48:43 -04:00
Nga Tran 1093542578 fix: now all tests pass. Next step is cleaning up and addressing review comments 2021-05-21 13:29:20 -04:00
Nga Tran 784ef88fcd chore: merge main to branch and add more tests that expose a wrong result bug on unsigned int 2021-05-21 12:38:06 -04:00
Nga Tran 93afc9c213 chore: more tests 2021-05-21 11:39:12 -04:00
Edd Robinson 3a93209f6a
Merge pull request #1536 from influxdata/er/fix/read_buffer/expression_support
fix: support converse binary expressions
2021-05-21 15:51:44 +01:00
Edd Robinson a65c729b01 fix: support converse binary expressions 2021-05-21 15:41:52 +01:00
kodiakhq[bot] d8e258f265
Merge pull request #1535 from influxdata/fixgrpcregistration
fix: gRPC health reporter registration
2021-05-21 10:52:00 +00:00
Marko Mikulicic 62fb445a1d
fix: gRPC health reporter registration 2021-05-21 11:46:45 +02:00
Raphael Taylor-Davies 5b619733d9
refactor: split lifecycle tracking from chunk state (#1361) (#1099) (#1397)
* refactor: split lifecycle tracking from chunk state (#1361) (#1099)

* chore: namespace internal errors

* chore: fix logical conflict

* chore: don't remove moving chunk size metric
2021-05-21 09:27:44 +00:00
kodiakhq[bot] 1cadee43d1
Merge pull request #1532 from influxdata/er/refactor/scalar_encoding
refactor: consolidate Read Buffer scalar encodings
2021-05-21 08:44:56 +00:00
Edd Robinson d5f02cb6c5 refactor: address PR feedback 2021-05-21 09:40:26 +01:00
Edd Robinson d57e3ae73e refactor: move scalar encodings 2021-05-20 22:58:30 +01:00
Edd Robinson 0ec2499f60 refactor: teach scalar RLE to return different type 2021-05-20 22:50:44 +01:00
Nga Tran e44a3a87db feat: fnow predicate is actuallu pushed down to RUB but there are bugs and not working yet 2021-05-20 16:56:15 -04:00
kodiakhq[bot] 6b8cc89a87
Merge pull request #1523 from influxdata/crepererum/issue1382-c
feat: read perserved catalog during DB startup
2021-05-20 15:56:16 +00:00
kodiakhq[bot] f028a356f4
Merge branch 'main' into crepererum/issue1382-c 2021-05-20 15:51:47 +00:00
kodiakhq[bot] 0f53937779
Merge pull request #1529 from influxdata/crepererum/remove_snapshotting
feat: remove snapshot feature
2021-05-20 14:20:05 +00:00
kodiakhq[bot] aac00d4fa6
Merge branch 'main' into crepererum/remove_snapshotting 2021-05-20 14:14:58 +00:00
kodiakhq[bot] d89455459e
Merge pull request #1530 from influxdata/detremotemap
feat: Add remote_template for simpler remote configuration
2021-05-20 13:03:24 +00:00
Marco Neumann 0e37d500eb feat: remove snapshot feature
The parquet files produced by this code path are only semi-specified and
will miss many important metadata aspects that we will require for data
lineage.
2021-05-20 14:59:04 +02:00
Marko Mikulicic 462a5590c6
fix: fmt 2021-05-20 14:58:50 +02:00
Marko Mikulicic c908cf0f98
fix: review suggestion
Co-authored-by: Edd Robinson <me@edd.io>
2021-05-20 14:40:02 +02:00
Marko Mikulicic 172530f7db
fix: review suggestion
Co-authored-by: Edd Robinson <me@edd.io>
2021-05-20 14:39:50 +02:00
Marco Neumann e28c031f76 refactor: make `ServerFixture::restart_server` consume the fixture
This also avoids an additional channel lock.
2021-05-20 14:30:30 +02:00
Marco Neumann 464667d8b8 docs: clarify the FilePath directory handling 2021-05-20 14:20:56 +02:00
Marko Mikulicic aa90329c1f
feat: Add remote_template for simpler remote configuration 2021-05-20 12:45:08 +02:00
kodiakhq[bot] 8c3e597cf3
Merge pull request #1524 from influxdata/er/perf/read_buffer_dict_read_filter
perf: teach Read Buffer to materialise string column results in dictionary format
2021-05-20 10:15:56 +00:00
Edd Robinson 4cb76e367b refactor: fix change to Chunk API 2021-05-20 11:11:18 +01:00
Edd Robinson 663a38862d refactor: address PR feedback 2021-05-20 10:49:49 +01:00