He Wang
bd1f91cd9c
fix sync order in RdbMirrorDbSyncService ( #3928 )
2022-05-13 14:19:40 +08:00
jianghang.loujh
67e85d201c
remove client adapter Docker
2022-05-13 12:46:12 +08:00
wanglei
6965726dfe
fix bug #2023 ( #3871 )
...
* fix bug #2023
* 配置canal-adapter，docker生成脚本
2022-05-13 12:39:43 +08:00
willmao
c0001afe8f
use hostname if register name not set ( #3968 )
2022-05-13 12:24:33 +08:00
xiayingfeng
977031a666
Improve MAVEN build Performance ( #4055 )
2022-05-13 12:23:33 +08:00
zhangshaoning
bd3224eea1
Upgrade reference log4j package version ( #4017 )
2022-05-13 12:22:45 +08:00
jianghang.loujh
33733aef25
fixed compatible and code format
2022-05-13 11:59:57 +08:00
zhangjukai
25be0259a4
Some tweaks for pulsarmq-connector ( #4060 )
...
* 1. Add the com.alibaba.otter.canal.connector.core.spi.CanalMsgConsumer file to the META-INF/canal directory under the pulsarmq-connector project
2. Introduce pulsar-client-admin for Canal to automatically create multi-partition topics
3. Add the judgment that roleToken is null
4. The disconnect method in CanalPulsarMQConsumer removes this.pulsarMQConsumer.unsubscribe();, this code will cause data loss during stop
5. When getting Pulsar messages, they are all processed as flat messages, because CanalMessageSerializerUtil.deserializer(data) will deserialize exceptions
6. Use groupId as subscriptName, without the pulsarmq.subscriptName parameter, the entire adapter will be the same subscriber name using pulsarmq.subscriptName
* 逻辑优化
* 代码优化
* 针对pulsar的调整
* 恢复代码
* 恢复代码
* 处理Producer失效的情况
2022-05-13 11:41:50 +08:00
liteng2430
8114d77a20
Add verification: the user can set a password with a length of less than 6 digits when updating the password, but the password length must be greater than or equal to 6 digits when logging in to canal admin, so the length verification function when updating the login password is added ( #4103 )
2022-05-13 11:34:36 +08:00
ZhangJian He
571e7f4e25
fix ojdbc6 wrong corrinator ( #4132 )
2022-05-13 11:33:42 +08:00
温绍锦
ead91433d7
fastjson update 1.x to 2.0.2 ( #4160 )
2022-05-13 11:32:47 +08:00
xiaoma20082008
bac016f89e
<feat>: support visibility columns ( #3976 )
2022-05-13 11:30:19 +08:00
willmao
8804647c30
avoid print password when logging ( #3969 )
2022-05-13 11:28:05 +08:00
mclubing
2623d08b8c
rdb配置不支持yaml后缀文件 ( #3964 )
...
增加rdb配置支持yaml后缀文件
2022-05-13 11:26:04 +08:00
wuare
622fed84ce
fixed logger name ( #3887 )
2022-05-13 11:24:00 +08:00
He Wang
9f5e8fd1c4
rollback guava version in adapter module ( #3880 )
2022-05-13 11:23:30 +08:00
Junwang Zhao
88d472ef1e
move protocol test to protocol test directory ( #3864 )
...
1. move the protocol test to right directory
2. fix wrong string format params count
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com >
2022-05-13 11:16:06 +08:00
Aiden.Ao
2987d08161
fix issue #3144 ( #3712 )
2022-05-13 11:09:09 +08:00
tuple
b54bea5e33
polish the code thus make it more stable ( #3855 )
...
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com >
2021-10-11 14:46:22 +08:00
jianghang.loujh
c42ba95eed
fixed pulsarmq package
2021-10-09 18:06:34 +08:00
jianghang.loujh
b48c434ffd
fixed phoenix version
2021-10-09 17:52:13 +08:00
jianghang.loujh
2c892fce9b
fixed issue #3484 , fixed bat script
2021-10-09 17:39:22 +08:00
jianghang.loujh
3bb49e19d2
fixed issue #3576 , stop exporter
2021-10-09 17:29:23 +08:00
jianghang.loujh
f26b84ffc2
fixed issue #3829 , kafka connector support k8s env
2021-10-09 16:31:59 +08:00
364102729 and agapple
0a2254eeaf
add tablestore adapter ( #3754 )
...
* add tablestore adapter
* add tablestore adapter
* fix bug add add log when etl fail
* fix bug，tinyint(1)以及rowupdatechange
Co-authored-by: agapple <jianghang115@gmail.com >
2021-10-09 16:06:13 +08:00
jianghang.loujh
40d840375f
fixed MR
2021-10-09 15:59:12 +08:00
Chad2li and agapple
5b6fd8094a
增加Apache Pulsar MQ支持 ( #3791 )
...
* done pulsarmq
* del pulsar consumer
* pulsar partition
* done pulsar consumer&connector
* update pulsar-client version to 2.8.1
Co-authored-by: agapple <jianghang115@gmail.com >
2021-10-09 15:51:45 +08:00
mikoto
4ce401d219
fix: 多destination的场景下只能生效一个 ( #3772 )
2021-10-09 15:38:26 +08:00
Jonathan Schneider and Moderne
de95a6a128
refactor: Use Java standard library instead of Guava ( #3708 )
...
Co-authored-by: Moderne <team@moderne.io >
Co-authored-by: Moderne <team@moderne.io >
2021-10-09 15:33:37 +08:00
happyrita
9e11c3c018
定时保存snapshot到DB的逻辑中，schema名称获取错误，在有配置canal.instance.filter.regex时，由于对应的table无法被匹配中，导致compareTableMetaDbAndMemory方法不被执行 ( #3693 )
...
* 避免重复订阅zk变更状态
* Update DatabaseTableMeta.java
获取schema的名称
* Update CanalController.java
2021-10-09 15:32:20 +08:00
arthasking123
d67bea8f3d
repair issue #3678,#3680 ( #3684 )
...
* repair issue #3678,#3680
* repair issue #3678,#3680
2021-10-09 15:30:32 +08:00
kkjinping
997957d6e0
新增配置 canal.mq.enableDynamicQueuePartition，获取topic对应的队列的数量为分区的数量，以支持动态队列的场景（如阿里云的rocketmq，无法人工设置队列数量，可能会动态伸缩） ( #3670 )
2021-10-09 15:26:23 +08:00
tanpenggood
ea20076a32
fix: rowChange typo ( #3593 )
2021-10-09 15:23:36 +08:00
dinosaur
2550d8eb65
Connection is already closed fix ( #3587 )
2021-10-09 14:54:05 +08:00
nick
31a0fdc807
add note ( #3550 )
2021-10-09 14:53:28 +08:00
lanicc
d79431c7e5
fix typo ( #3532 )
2021-10-09 14:53:00 +08:00
ruanjl
911711248c
修复rds高可用主从切换和oss相关问题 ( #3480 )
...
* 修复rds oos 拉取的binlog 的消费逻辑以及本地消费到直连消费的逻辑衔接
* 去除无用代码
2021-10-09 14:51:41 +08:00
spark and lihuav2017
63407dc570
canal adapter phoenix ( #3290 )
...
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
Co-authored-by: lihuav2017 <lihua@able-elec.com >
2021-10-09 14:37:11 +08:00
flowell
3c20fd09ad
fix issue #3839 : 修复alter table character set类型DDL语句解析BUG ( #3840 )
2021-10-09 14:28:56 +08:00
ChenZhangg and Chen Zhang
eef3bd92ba
Improve MAVEN build Performance ( #3851 )
...
Co-authored-by: Chen Zhang <340355960@qq.com >
2021-10-09 14:26:26 +08:00
agapple
474063af3b
fixed issue #3494 , polardb-x 2.0 cdc support implicit_id/varaibles
2021-04-28 13:42:55 +08:00
agapple
5cc85ff2de
[maven-release-plugin] prepare for next development iteration
2021-04-19 15:48:20 +08:00
agapple
64862503ba
[maven-release-plugin] prepare release canal-1.1.5
2021-04-19 15:48:09 +08:00
agapple
f9e0dc7daa
fixed testcase
2021-04-19 15:15:10 +08:00
agapple
0c399509a9
upgrade druid 1.2.6
2021-04-19 12:57:21 +08:00
agapple
a09cd9adb5
fixed issue #3110 , json escapse
2021-04-19 11:28:45 +08:00
agapple
1369418c6a
fixed code format & merge
2021-04-19 10:55:43 +08:00
995586041
75174a63af
增加rabbitmq消息持久化deliveryMode配置 ( #3300 )
2021-04-19 10:29:23 +08:00
zoemak
17f4ee13e7
自动注册时可自定义node server名称，canal.properties#canal.admin.register.name，为空则使用canal.register.ip ( #3459 )
2021-04-19 10:18:01 +08:00
Fei Yang
f0417502f8
fix: unit_present typo ( #3461 )
...
https://github.com/alibaba/canal/issues/3434
2021-04-19 10:16:17 +08:00
He Wang
jianghang.loujh
wanglei
willmao
xiayingfeng
zhangshaoning
zhangjukai
liteng2430
ZhangJian He
温绍锦
xiaoma20082008
mclubing
wuare
Junwang Zhao
Aiden.Ao
tuple
364102729andagapple
Chad2liandagapple
mikoto
Jonathan SchneiderandModerne
happyrita
arthasking123
kkjinping
tanpenggood
dinosaur
nick
lanicc
ruanjl
sparkandlihuav2017
flowell
ChenZhanggandChen Zhang
995586041
zoemak
Fei Yang