milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,721 Commits
126 Branches
113 Tags
558 MiB
Commit Graph

1145 Commits (760e9c5df2d92c0b34fa704962a9f66c5c9d34fd)

Author SHA1 Message Date
Xiaofan 5355153805
Minio Error is not Handled gracefully (#17003) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-16 19:25:55 +08:00
groot 168935f4cf
Fix bulkload bug for string primary key (#16958) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-05-13 16:07:54 +08:00
exia 4ee78eb5ad
proxy support tls (#16706) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-05-10 20:05:53 +08:00
Bingyi Sun 76bfd41952
Refine DataNode logs. (#16849) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-05-09 16:25:52 +08:00
Enwei Jiao 67ce206cf0
make SegmentMaxLifetime configurable (#16783) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-06 23:41:51 +08:00
Jiquan Long 98ceb162aa
Support antlr as plan parser (#16696) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: xaxys <tpnnghd@163.com>

Co-authored-by: xaxys <tpnnghd@163.com>
 2022-05-06 17:43:51 +08:00
groot 8736372fd2
Fix bulkload bugs (#16760) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-05-06 11:21:50 +08:00
Ten Thousand Leaves 1acd256481
Add DataQueryable and DataIndexed states for bulk load tasks (#16725) 
issue: #16607

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-05-05 21:17:50 +08:00
Xiaofan 333b439a6c
Support config grpc log level (#16618) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 10:35:50 +08:00
shaoyue fa97f86cda
Clean up not used id_cache related code (#16655) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-05-05 09:59:51 +08:00
Xiaofan 337ad53613
Support config small index nprobe and nlist (#16731) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-05 09:49:50 +08:00
cai.zhang 2be46a01c0
Reduce the number of retries and add error log (#16754) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-05-05 09:31:51 +08:00
Cai Yudong 6a62ff18bf
Support easylogging config for segcore and knowhere (#16751) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-05-03 08:39:49 +08:00
Jiquan Long 2fe8677cbf
Enable dimension check in Proxy when create index request received (#16718) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 18:01:49 +08:00
shaoyue 2f49db9d3c
Implements remaining rest APIs (#16387) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-04-29 15:15:47 +08:00
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
groot 21b5973253
Refine list import task api (#16690) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-28 17:21:47 +08:00
yah01 206b554d49
Sync the distribution of segments to shard leaders (#16685) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-28 16:01:48 +08:00
Xiaofan ed51ffd50f
Fix Compact Entity ttl param (#16665) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-28 11:51:47 +08:00
congqixia 0bf176a7e1
Add SyncReplicaSegments interface for QueryNode (#16672) 
Add SyncReplicaSegments for LoadCollection/LoadPartition child task
This API notifies related ShardCluster to record segment Loaded
Preventing the Etcd events is delayed, which will cause some segment not search

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-27 10:41:46 +08:00
yah01 80ae6de323
Add comments for concurrency package (#16654) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-26 11:33:45 +08:00
groot bc5e9ec929
Add list import tasks api (#16605) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-25 17:37:46 +08:00
yah01 7af02fa531
Improve load performance, load binlogs concurrently per file, deserialize binlogs concurrently per field/segment (#16514) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-25 15:57:47 +08:00
Xiaofan 89b4a34892
Fix Data race in NodeID (#16603) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-24 22:03:44 +08:00
groot a6a3b69d91
Report bulk load state (#16555) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-21 21:37:42 +08:00
codeman 91e84ffedf
fix: not create user root if exists, optimize log & imports (#16554) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-21 19:57:42 +08:00
Ten Thousand Leaves 6f75d02c65
Disable knowhere logging for embedded Milvus and some other tweaks (#16496) 
/kind enhancement

issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 17:23:46 +08:00
Ten Thousand Leaves 289e468a7a
Make bulk load fully work (#16512) 
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 14:03:40 +08:00
codeman 3a1b2cedd2
create default root user for authentication (#16545) (#16549) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-20 13:03:40 +08:00
Xiaofan f367249b9e
Fix storage type config key (#16542) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-19 17:47:39 +08:00
codeman f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
Xiaofan fce8f6cfab
Remove Timetick channel (#16449) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-17 23:47:36 +08:00
godchen 4781db8a2a
Add datanode import (#16414) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-12 22:19:34 +08:00
jaime ed3c29eae7
Support Kafka (#16149) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-12 19:47:33 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-11 19:49:34 +08:00
congqixia 994bb829d3
Use fmt.Errorf instead of string concat in schema.go (#16404) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-11 09:47:37 +08:00
Cai Yudong 71cd7ba67a
Add configuration common.indexSliceSize (#16438) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-04-08 20:29:33 +08:00
godchen bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
Ten Thousand Leaves 1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-06 15:33:32 +08:00
XuanYang-cn 78200009a3
Impl GetReplicas in Proxy (#16390) 
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-04-06 14:57:31 +08:00
Ten Thousand Leaves 2bd0a9526a
Implement task expiring logic and make all deadlines configurable. (#16355) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-03 11:37:29 +08:00
groot be8d9a8b6b
Support import numpy file (#16348) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-03 11:27:29 +08:00
xige-16 99984b88e1
Support delete varChar value (#16229) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-04-02 17:43:29 +08:00
Letian Jiang 028c5cb882
Modify grpc interface for replica Search/Query in QueryNode (#16326) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-04-02 14:15:31 +08:00
XuanYang-cn 5494f3c318
Remove offLineNodes from watch states check (#16347) 
This PR also
- adds more information in log
- makes Session able to logged by zap.Any/zap.String

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-04-01 22:33:29 +08:00
yah01 c005f07ccc
Modify proto to add GetReplicas() interface (#16328) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-04-01 16:15:29 +08:00
Jiquan Long fd589baca7
Integrates marisa trie index (#16192) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-01 15:31:29 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-01 11:33:28 +08:00
groot bd241cd28b
Add performance test case for import (#16296) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-01 10:07:28 +08:00
XuanYang-cn 58addbf9f4
Add GetShardLeaders rpc in querycoord proto (#16299) 
See also: #16298

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-03-31 16:39:29 +08:00
congqixia f529f8c1fc
Use fmt.Errorf instead of str concat in func.go (#16315) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-31 15:03:28 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
groot ffa06c77b6
Import util functions (#16237) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-30 16:25:30 +08:00
congqixia 18a3e9f265
Add grpc interface for replica Search/Query in QueryNode (#16197) 
Resolves #16195
Add Search and Query grpc interface in query proto and types/types.go

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-03-30 12:03:27 +08:00
godchen 478f6ca11e
Add cache for vector chunk (#15912) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-03-26 22:05:26 +08:00
xige-16 205c92e54b
Support insert string data (#15993) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-25 14:27:25 +08:00
Cai Yudong f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-25 13:49:25 +08:00
Ten Thousand Leaves a23ca745bb
Add Etcd support for Import Tasks. (#16164) 
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-25 11:03:25 +08:00
bigsheeper 2fcf7b9760
Fix GetMemoryCount, get min as total memory (#15931) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-03-24 20:41:25 +08:00
xiyichan ca129d4308
Support configurable msgstream (#16131) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-03-24 10:15:25 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-22 15:11:24 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-21 14:23:24 +08:00
Xiaofan 787d4f8bfd
Refine prometheus metrics and etcd log (#16084) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-03-18 15:51:22 +08:00
Ji Bin 3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
edward.zeng d4ad785b76
Bump go version in documentation (#15979) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-03-16 18:51:21 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
zhenshan.cao 0bd07daae3
Add grpc healthy check (#16050) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 15:05:21 +08:00
XuanYang-cn d4a0c5eba6
Alter comments in parallel.go for readability (#16032) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-03-15 10:26:01 +08:00
xige-16 09b2c46b61
Support create collection with VarChar field (#15904) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-03-14 23:20:02 +08:00
jaime 29975a7a26
Remove Consume() API from mqstream interface (#15886) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-11 20:09:59 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-11 17:13:59 +08:00
yah01 7d2934e4c2
Add methods to compress/decompress small blocks (#15980) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-11 14:55:59 +08:00
Ten Thousand Leaves d5bae6710f
Make all logs configurable for standalone/embedded Milvus. (#15926) 
Resolves: #15919, #15708
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-10 10:35:59 +08:00
groot 5fdef607d5
Add rpc interfaces for import (#15930) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-09 18:33:59 +08:00
yah01 565524ed3c
Add zstd compressor in util (#15779) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-03-08 18:17:58 +08:00
Jiquan Long f71651e294
Support column-based insert data in message stream (#15802) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-04 15:09:56 +08:00
Cai Yudong 3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-04 11:17:56 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-03 21:57:56 +08:00
Cai Yudong 92c8e32ebd
Let MemoryKV.Load return error when key not exist (#15814) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-02 18:51:55 +08:00
XuanYang-cn e394ba8c88
Refactor rocksmq comments and logs for readability (#15801) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-03-01 18:55:55 +08:00
Jiquan Long 001567640e
Fix shallow copy of typeutil.AppendFieldData (#15790) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-01 15:13:54 +08:00
Bingyi Sun d6857f4b24
Remove globalZapWrapper in logutil.go (#15726) 
issue: #15720

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-02-28 17:23:54 +08:00
yah01 867cf620ee
Add Extract() method to take out C pointer from BytesConverter without releasing it (#15614) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2022-02-27 09:47:53 +08:00
Nemo cdcb3627b4
Make Etcd log level configurable. (#15737) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-02-25 15:03:53 +08:00
godchen fcf0887d92
Add and implement chunk manager interface. (#15541) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-02-24 23:53:53 +08:00
shaoyue 83fdc1da7c
Add web server in proxy with sample handler (#15647) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-02-23 14:37:52 +08:00
congqixia c7f55c2e34
Make SessionWatch keep watch even no Rewatch func when find ErrCompacted (#15497) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-02-15 15:07:48 +08:00
yah01 684110bc9a
Avoid to copy during converting C bytes to Go bytes (#15551) 
* Avoid to copy during converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>

* Add BytesConverter to achieve no-copy converting C bytes to Go bytes

Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2022-02-15 14:17:48 +08:00
Xiaofan be42627ab2
Move Logutil to Util dir (#15447) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-02-09 18:55:46 +08:00
Cai Yudong 8255b713ac
Move ProxySubName/QueryNodeSubName/DataNodeSubName to msgChannelConfig (#15501) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-09 14:41:45 +08:00
jaime 307a8ce535
Support compile and run on Mac (#15491) 
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
 2022-02-09 14:27:46 +08:00
xige-16 55cdc5aa35
Get indexInfo and segment size by queryCoord (#14207) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-02-08 21:57:46 +08:00
Cai Yudong 1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-08 20:57:47 +08:00
JunSung Park f6873d3dc1
Implement automatic item expiration on compaction (#14418) 
* Implement automatic item expiration on compaction

Signed-off-by: JunSung Park <writtic@gmail.com>

* Change entityExpiration value comparison logic

Signed-off-by: JunSung Park <writtic@gmail.com>

* Add logging for the number of expired entity

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default value of CompactionEntityExpiration to off

Signed-off-by: JunSung Park <writtic@gmail.com>

* Fix errors for code checker

Signed-off-by: JunSung Park <writtic@gmail.com>

* Set default entityExpiration to max value

Signed-off-by: JunSung Park <writtic@gmail.com>
 2022-02-07 22:45:46 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong 4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-02 00:35:43 +08:00
Bingyi Sun 515fe962d5
Fix subscription path (#15373) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-25 13:27:44 +08:00
Bingyi Sun 3987574448
Unsubscribe topic in DataCoord (#15353) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-24 19:47:38 +08:00
xige-16 1cd2363bd8
Delete usless params SkipQueryChannelRecovery (#15289) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-21 21:43:40 +08:00
Bingyi Sun c877f33084
Downgrade pulsar client (#15325) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-01-20 22:25:38 +08:00
congqixia 1e61112b5a
Add retry logic in pulsar consumer unsubscribe (#15284) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-20 01:23:37 +08:00
bigsheeper 7f775096c5
Unsubscribe when close pulsar consumer (#15221) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-01-17 18:53:36 +08:00
xige-16 dfc6670f0f
Unsubscribe channel after query node down (#15230) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-17 17:37:37 +08:00
Jiquan Long 675e6d352b
QueryNodes send search/query results by rpc (#15223) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-17 14:41:35 +08:00
zhenshan.cao 1601a61b78
Move logic of checking available port to service (#15222) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-14 21:17:34 +08:00
zhenshan.cao f14df1d2db
Initilize listener in service instead of ParamTable (#15220) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-14 18:29:34 +08:00
Cai Yudong 951249c6c1
Use KnowhereConfig for indexnode and querynode (#15112) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-11 09:35:34 +08:00
zhenshan.cao 543e348730
[skip e2e]Update license (#15131) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-11 00:09:34 +08:00
zhenshan.cao 0f7a04fc8c
[skip e2e]Update license (#15129) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-11 00:03:38 +08:00
zhenshan.cao 6d36fc60cf
[skip e2e]Update license (#15132) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-11 00:01:36 +08:00
zhenshan.cao e5e739ec26
[skip e2e]Update license (#15127) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-10 23:59:43 +08:00
zhenshan.cao 2962ceeb65
[skip e2e]Update license (#15126) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-10 23:57:40 +08:00
jaime 828b9d399f
[skip e2e] Update license (#15123) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-10 22:45:37 +08:00
jaime 96dde53240
[skip e2e] Update license (#15122) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-10 22:43:41 +08:00
jaime fca29c6db0
[skip e2e] Update license (#15121) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-10 22:23:46 +08:00
zhenshan.cao 1aafb56694
Clarify the index building process (#15044) 
Reduce peak memory usage

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-10 20:51:34 +08:00
Cai Yudong 6323907566
Use CommonConfig in GlobalParams for all components (#15106) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 19:03:35 +08:00
jingkl b2cb15798d
[skip e2e] Add comments to conf adapter (#15097) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-10 18:37:37 +08:00
jingkl d3c6d47537
[skip e2e] Add comments to conf adapter (#15096) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-10 18:35:40 +08:00
Cai Yudong b6a48817b0
Add MinioConfig in GlobalParams for all components (#15099) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 17:29:34 +08:00
jingkl d719f1edb7
[skip e2e] Add comments to conf adapter (#15095) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-10 16:49:34 +08:00
Cai Yudong ee60e95310
Use RocksmqConfig in GlobalParams (#15083) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 14:51:34 +08:00
edward.zeng 08bb5b3b75
[skip e2e] Update mqclient rmq id test license (#15079) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-10 13:35:55 +08:00
edward.zeng bf804d74bf
[skip e2e] Update mqclient rmq id license (#15078) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-10 13:34:04 +08:00
edward.zeng 1b96086285
[skip e2e] Update mqclient rmq consumer license (#15077) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-10 13:32:04 +08:00
Xieql f2c01e81c3
[skip e2e] Improve annotation (#15069) 
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
 2022-01-10 13:22:32 +08:00
XuanYang-cn d80e61e26c
[skip e2e]Update license for trace stack trace (#15057) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-10 13:05:20 +08:00
XuanYang-cn 25efd97f2a
[skip e2e]Update license for trace interceptor suite (#15056) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-10 13:03:23 +08:00
XuanYang-cn 94750960c4
[skip e2e]Update license for tsoutil tso (#15055) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-10 12:58:49 +08:00
XuanYang-cn f4b5a6733e
[skip e2e]Update license for typeutil hash (#15035) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-10 10:47:34 +08:00
Cai Yudong 7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-09 23:45:33 +08:00
XuanYang-cn e2d16ed84d
[skip e2e]Update license for type (#15037) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-07 23:21:34 +08:00
XuanYang-cn 504550df73
[skip e2e]Update license for typeutil time (#15036) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-07 23:19:38 +08:00
XuanYang-cn df179aa09b
[skip e2e]Update license for typeutil index (#15034) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-07 23:17:44 +08:00
XuanYang-cn 9ba61d7223
[skip e2e]Update license for typeutil schema (#15033) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-07 23:15:45 +08:00
XuanYang-cn ef21e41175
[skip e2e]Update license for typeutil string util (#15032) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-07 23:13:50 +08:00
jaime 24b48743e5
[skip e2e] Add license (#15031) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-07 23:11:56 +08:00
jaime def0dc33a5
[skip e2e] Add license (#15030) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-07 23:09:50 +08:00
jaime 701cbf3284
[skip e2e] Update license (#15029) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-07 23:07:42 +08:00
congqixia eb1db3360a
[skip e2e] Improve log for rmq retention DeleteMessages (#15025) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-07 21:15:34 +08:00
jingkl 6616dbe6dd
[skip e2e]Add comments to conf adapter file (#15017) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-07 19:11:23 +08:00
jingkl e108a64135
[skip e2e]Add comments to conf adapter file (#15015) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-07 19:07:32 +08:00
jingkl 6d526fbb3d
[skip e2e]Add comments to conf adapter file (#15014) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-07 19:05:41 +08:00
edward.zeng 6d86d80dcb
[skip e2e] Update mqclient rmq client license (#15007) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-07 18:49:25 +08:00
edward.zeng 2e012fa99f
[skip e2e] Update mqclient reader license (#15006) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-07 18:45:28 +08:00
edward.zeng 718564927d
[skip e2e] Update mqclient rmq client test license (#15008) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-07 18:43:21 +08:00
Jiquan Long 7f47ef0244
Optimize workflow of parallel (#15001) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-07 18:07:22 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-07 16:15:26 +08:00
congqixia dec68280dc
Use ElementMatch instead of Equal in unit test (#14997) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-07 15:17:22 +08:00
Xieql 5109b88552
[skip e2e] Improve annotation (#14979) 
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
 2022-01-07 14:01:50 +08:00
Xieql 0700312a4e
[skip e2e] Improve annotation (#14977) 
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
 2022-01-07 13:59:58 +08:00
shaoyue 19bb516aab
[skip e2e] Fix comment typo for mqclient message (#14988) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-07 13:29:28 +08:00
shaoyue 0b74c62aed
[skip e2e] Add comment for global param (#14987) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-07 13:27:38 +08:00
Xieql cc66847f9a
[skip e2e] Improve annotation (#14983) 
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
 2022-01-07 13:25:42 +08:00
yukun ae27be637d
[skip e2e]Add comment for pulsar producer (#14945) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2022-01-07 09:51:28 +08:00
yukun 7b873602c1
[skip e2e]Add comment for pulsar client (#14944) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2022-01-07 09:49:34 +08:00
jaime 29e37e3379
[skip e2e] Update license (#14961) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-06 23:39:34 +08:00
jaime 2751d1abbb
[skip e2e] Update license (#14959) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-06 23:37:39 +08:00
jaime b88c313424
[skip e2e] Update license (#14960) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-06 23:19:41 +08:00
congqixia da4182a90f
Use GroupChecker for flowgraph node input check (#14916) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-06 19:27:25 +08:00
edward.zeng 7bda81d050
[skip e2e] Update mqclient pulsar reader test license (#14933) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-06 18:17:54 +08:00
edward.zeng 81ccade3f3
[skip e2e] Add license for mqclient pulsar reader (#14932) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-06 18:16:03 +08:00
edward.zeng 04f7f7ce2a
[skip e2e] Update mqclient pulsar producer test license (#14931) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-06 18:14:07 +08:00
jingkl 13e27c9803
[skip e2e]Add comments to conf adapter file (#14930) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-06 18:12:15 +08:00
jingkl 078a1e0a42
[skip e2e]Add comments to conf adapter file (#14929) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-06 18:08:18 +08:00
jingkl f68c1a7a74
[skip e2e]Add comments to conf adapter file (#14927) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-06 18:06:15 +08:00
XuanYang-cn 92b8eddb5c
[skip e2e]Update license for util uniquegenerator (#14786) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 14:53:20 +08:00
XuanYang-cn 06ae5b19a3
Remove not inuse configs (#14836) 
- segmentBinlgoSubPath
- collectionBinlogSubPath
- flushStreamPosSubPath
- statsStreamPosSubPath

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-06 14:49:20 +08:00
shaoyue 8b70ae0507
[skip e2e] Add comment for global param (#14926) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-06 13:51:21 +08:00
shaoyue 00d06f2562
[skip e2e] Add comment for base table (#14925) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-06 13:49:27 +08:00
guoxiangzhou 105c4c5e70
[skip e2e] Modify code comments according to the naming conventions (#14893) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-06 13:13:51 +08:00
guoxiangzhou d4c45f6f7f
[skip e2e] Modify code comments according to the naming conventions (#14892) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-06 13:11:52 +08:00
guoxiangzhou 2836b1c670
[skip e2e] Modify code comments according to the naming conventions (#14896) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-06 13:09:49 +08:00
guoxiangzhou 8d128e1659
[skip e2e] Modify code comments according to the naming conventions (#14895) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-06 13:07:53 +08:00
guoxiangzhou 02fde5982a
[skip e2e] Modify code comments according to the naming conventions (#14894) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-06 13:05:59 +08:00
zhenshan.cao ab771bc137
[skip e2e]Update license (#14791) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-06 10:07:21 +08:00
edward.zeng eb468b09a5
[skip e2e] Update mqclient pulsar message license (#14859) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-06 09:39:25 +08:00
Cai Yudong d01931d8d9
[skip e2e] Remove useless configuration rootcoord.timeout (#14852) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-05 19:05:25 +08:00
edward.zeng 1c7e8bbcaf
[skip e2e] Update mqclient pulsar id test license (#14858) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-05 18:57:21 +08:00
edward.zeng 4b58c4f42a
[skip e2e] Update mqclient pulsar producer license (#14860) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-05 17:19:20 +08:00
jingkl 46f8d2dff0
[skip e2e]Add comments to conf adapter file (#14857) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-05 17:15:26 +08:00
congqixia 921501dfac
Fail fast when pulsar subscribe exlusive timeout (#14844) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-05 16:19:20 +08:00
shaoyue 3b2d14a00c
[skip e2e] Add comments for index type (#14805) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-05 13:58:05 +08:00
shaoyue bb7d0fb2ad
[skip e2e] Add comment for base table (#14804) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-05 13:56:05 +08:00
XuanYang-cn 31c969b76f
[skip e2e]Update license for typeutil convension (#14787) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-05 09:45:33 +08:00
jaime d9bc40c033
[skip e2e] Update license (#14795) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-04 22:41:45 +08:00
jaime c9e58da5d4
[skip e2e] Update license (#14794) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-04 22:41:21 +08:00
jaime 06090c97cb
[skip e2e] Update license (#14796) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2022-01-04 21:53:23 +08:00
zhenshan.cao 66aff46d8e
[skip e2e]Update license (#14790) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-01-04 21:13:23 +08:00
edward.zeng 03037f4ea7
[skip e2e] Update mqclient pulsar consumer test license (#14777) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-04 20:07:24 +08:00
edward.zeng e11e26ab54
[skip e2e] Update mqclient pulsar id license (#14778) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-04 19:04:12 +08:00
edward.zeng 672d05a37a
[skip e2e] Update mqclient pulsar client test license (#14776) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2022-01-04 19:03:29 +08:00
jingkl 44c53b10da
[skip e2e]Add comments to conf adapter file (#14762) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-04 16:23:39 +08:00
Jiquan Long 841c5af42e
Fixbug: client connection reset by deadline (#14683) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-04 15:13:18 +08:00
godchen 9e51591b3a
Fix pulsar reader not close (#14543) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-01-04 14:45:19 +08:00
jingkl 6b7884d29b
[skip e2e]Add comments to conf adapter file (#14761) 
* [skip e2e]Add comments to conf adapter file

Signed-off-by: jingkl <jingjing.jia@zilliz.com>

* [skip e2e]Add comments to conf adapter file

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-04 14:25:19 +08:00
jingkl 0e4df25e36
[skip e2e]Add comments to conf adapter file (#14760) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-01-04 14:23:22 +08:00
shaoyue b6b62c025e
[skip e2e] Add comment for base table (#14723) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2022-01-04 10:47:27 +08:00
guoxiangzhou 915f11b1cd
[skip e2e] Modify log text according to the naming conventions (#14716) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-04 10:29:18 +08:00
guoxiangzhou d00d5bd651
[skip e2e] Modify log text according to the naming conventions (#14713) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-01-04 10:27:22 +08:00