wyl/canal
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
1,480 Commits 10 Branches 29 Tags
6965726dfeaba4f175d23c2d77e11bd7553506b2
Commit Graph
190 Commits
Author SHA1 Message Date
Junwang Zhao 88d472ef1e move protocol test to protocol test directory (#3864) 
1. move the protocol test to right directory
2. fix wrong string format params count

Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>
 2022-05-13 11:16:06 +08:00
kkjinping 997957d6e0 新增配置 canal.mq.enableDynamicQueuePartition，获取topic对应的队列的数量为分区的数量，以支持动态队列的场景（如阿里云的rocketmq，无法人工设置队列数量，可能会动态伸缩） (#3670) 2021-10-09 15:26:23 +08:00
agapple 5cc85ff2de [maven-release-plugin] prepare for next development iteration 2021-04-19 15:48:20 +08:00
agapple 64862503ba [maven-release-plugin] prepare release canal-1.1.5 2021-04-19 15:48:09 +08:00
zavakid 6989eb3d2b + fix logging call placeholders number 2020-09-17 23:26:02 +08:00
zavakid df24596092 = code cleanup 
- for loop replaceable with enhanced 'for' loop
  - using diamond in generic type
  - collapse try catch exception
  - using try-with-resource
  - using  List#sort instead of Collections#sort
  - replaced lambda with method reference
  - using native compare method to compare numbers
  - using switch instead of if for in ESSyncUtil
 2020-09-17 23:22:25 +08:00
zavakid 43c23ffb97 = remove unused improt 2020-09-17 22:40:06 +08:00
zavakid e7658879bc = cold cleanup 
* using lambda if possible (we are already building in Java8)
  * using diamond when new generic instance
  * remove used improt
 2020-09-17 17:46:20 +08:00
zavakid df60eda679 = code cleanup 2020-09-16 14:18:05 +08:00
liguangyao b81e9dfeb8 支持不同topic指定专属partitionNum (#2479) 2020-08-22 13:11:53 +08:00
agapple b79af46054 merge code and fixed issue #2755 #2756 #2735 #2714 #2711 #2710 #2616 #2602 #2585 #2565 #2935 #2434 #2623 #2418 #2387 2020-08-22 13:07:24 +08:00
DinoZhang 72ae7ba8d7 meta admin (#2836) 2020-08-20 21:18:00 +08:00
rewerma 265a8e8594 模块化mq connector (#2562) 
* add connector module, add kafka producer connector module for server

* add rocketMQ producer connector module for server

* add rabbitMQ producer connector module for server

* optimize code, add annotation

* add canal message consumer connector for canal-adapter module
 2020-02-28 11:00:08 +08:00
agapple 1fa9020599 format 2019-10-15 21:38:48 +08:00
agapple dd7554374f format 2019-10-15 21:35:57 +08:00
shicongyang 65b5325ca6 建议增加一个属性，针对根据某一字段hash时，hash算法可以不根据database算出 #2248 (#2294) 2019-10-15 21:32:42 +08:00
agapple b64a3e301a fixed issue #2286 , ArithmeticException zero 2019-10-10 15:37:17 +08:00
agapple dd93e2b0c4 fixed issue #2258 , optimizer rabbitmq send perf & matchTopics only match one Topic 2019-09-30 20:42:52 +08:00
agapple d505b5ab9d fixed issue #2258 , optimizer rocketmq send perf 2019-09-30 20:19:25 +08:00
agapple 0fb717a97f fixed issue #2258 , optimizer kafka send perf 2019-09-30 14:24:59 +08:00
耐小心 79552e0a37 rabbitmq(amqp)MQ支持 (#2156) 2019-09-16 12:43:02 +08:00
agapple 2bde4327c7 [maven-release-plugin] prepare for next development iteration 2019-09-02 14:24:16 +08:00
agapple d53bfd7ee7 [maven-release-plugin] prepare release canal-1.1.4 2019-09-02 14:24:03 +08:00
agapple 4e0b8a0278 fixed admin 2019-08-31 12:24:41 +08:00
rewerma 274e91f8aa bug fix (#2122) 
* admin端口调整完成

* server端适配调整

* 调整部分功能

* 单机/集群admin调试完成

* 重新发布前端页面

* bug fix

* 解决server端admin配置会被远程覆盖的问题
解决default-instance.xml无法加载远程zkServers配置的问题

* 集群模式下取活动实例的问题
 2019-08-31 12:22:16 +08:00
agapple 3d4dbc9a8c fixed issue #2099 , support user/passwd acl and canal admin operator 2019-08-26 18:16:33 +08:00
rewerma fdd0763567 新增es adapter rest client和认证机制 (#2046) 
* 新增es adapter rest client和认证机制

* 修改getMapping位置

* 代码调整

* 代码调整

* 整理代码

* fix #2048
 2019-08-21 12:44:57 +08:00
rewerma 7cec0994e9 Merge branch 'master' into master 2019-07-14 19:24:42 +08:00
rewerma 64ff140304 modify 2019-07-11 01:05:11 +08:00
agapple a847660a45 fixed issue #1826 , remove kafka transaction send 2019-06-26 16:02:19 +08:00
agapple 4957083493 fixed issue #1897 , memory event store ack null 2019-06-25 17:32:46 +08:00
agapple 5bea876ec9 fixed issue #1352, add pkNames for flatMessage partition 2019-06-18 21:44:52 +08:00
BillowX 74489d1bba 当MQ配置为Kafka时，支持配置Kerberos认证 (#1895) 2019-06-18 15:02:14 +08:00
Z6N 5ac0f7b710 按主键散列，未设置主键时无限空指针异常 (#1889) 
当按注解散列时，如果监控的表未显示设置主键，将会导致flatMessage.getPkNames()为空，导致无限空指针异常
 2019-06-18 15:01:00 +08:00
agapple 058e1fc546 fixed delete message send mq bugfix 2019-05-28 00:14:20 +08:00
nieyuan1991 f9989e0856 fix:未捕获kafka事务异常，造成canal ack异常 (#1814) 2019-05-28 00:02:25 +08:00
Marsss___ 37fc248ebf 删除操作计算hash值的情况没有考虑，导致删除时的分区和插入时的分区不一致 (#1848) 2019-05-27 23:54:25 +08:00
Heng Du d0a83aad27 Support seamless docking with Alibaba Cloud RocketMQ commercial service (#1849) 2019-05-27 23:51:32 +08:00
rewerma 16f335c381 修复rest etl 存在SQL注入风险 (#1685) 
* kafka 模式默认开启事务异步发送

* fix adapter etl rest sql inject bug
 2019-04-15 23:58:12 +08:00
Xin Wang 8cb85753bb open the switch to get codecov test coverage (#1671) 
* add codecov for test coverage
 2019-04-09 19:11:48 +08:00
agapple 69df50fe17 fixed issue #1672 , CanalKafkaProducer send 2019-04-08 19:57:00 +08:00
agapple fadfe1d6ca [maven-release-plugin] prepare for next development iteration 2019-04-04 10:25:44 +08:00
agapple a7b12c7098 [maven-release-plugin] prepare release canal-1.1.3 2019-04-04 10:25:29 +08:00
agapple 82ed9db8ae fixed rocketmq partition out of range 2019-04-03 11:26:31 +08:00
agapple a7f9a779ad fixed issue #1640 , support schema partition 2019-03-28 17:01:36 +08:00
wangsaner 9826948ebb 修改canal.mq.partitionHash散列规则， 
当指明pk级做分区（schema.table:pk1^pk2）时，由table.hashCode()^column.getValue().hashCode()改为database.hashCode()^column.getValue().hashCode()，从而支持同库下不同表hash至相同分区
 2019-03-28 16:01:02 +08:00
agapple 97640b717b fixed compiler 2019-03-28 10:23:33 +08:00
wangsaner 739963acd0 fixed issue #1636 
非flat模式，当MQ主题为多分区时，数据拆分只取了for循环里面的最后一份数据，
导致消费端只能消费到一个分区的数据
 2019-03-27 21:57:04 +08:00
agapple 0ec4699149 fixed format & support Mysql Auth Switch Protocol 2019-03-27 11:54:40 +08:00
agapple 661d119265 fixed issue #1625, mq dymaic topic match 2019-03-25 17:54:35 +08:00