jianghang.loujh
a96db39420
add polardb-x parser test
2022-06-13 09:39:29 +08:00
温绍锦
bac1d543f1
update fastjson & druid version ( #4224 )
...
* 修复升级2.0.4导致兼容的问题
* update druid & fastjson version
2022-06-13 09:31:46 +08:00
jianghang.loujh
753fad6639
fixed issue #4216 , support polardb-x show tables
2022-06-10 13:36:39 +08:00
jianghang.loujh
bc4dceea1a
fixed issue #4216 , support polardb-x show databases
2022-06-10 11:37:52 +08:00
温绍锦
7aaee7b439
修复升级2.0.4导致兼容的问题 ( #4202 )
2022-05-30 10:29:38 +08:00
温绍锦
e19bf1ecff
Fastjson2 compatible fix ( #4189 )
...
* update fastjson2 version, 2.0.2 -> 2.0.3
* update fastjson & druid version
* bug fix for fastjson2 compatible
2022-05-25 10:22:26 +08:00
jianghang.loujh
a99dc0cbe8
fixed testcase
2022-05-24 11:18:40 +08:00
jianghang.loujh
7b8ff04d20
[maven-release-plugin] prepare for next development iteration
2022-05-24 10:26:12 +08:00
jianghang.loujh
7ee246ca5a
[maven-release-plugin] prepare release canal-1.1.6
2022-05-24 10:26:06 +08:00
jianghang.loujh
54c645f315
fixed test failed
2022-05-24 10:12:26 +08:00
jianghang.loujh
6c81ab6fdc
fixed compiler error
2022-05-24 10:08:02 +08:00
jianghang.loujh
99aefaa118
support mysql 8.0 transaction_payload_event
2022-05-23 23:23:52 +08:00
jianghang.loujh
e2248b3d35
update phoenix pom.xml
2022-05-23 19:30:19 +08:00
jianghang.loujh
eef1ee85fb
fixed issue #4014 , support java8 & java11 G1 GC
2022-05-23 18:23:31 +08:00
温绍锦
7dfec19c68
update druid & fastjson2 version ( #4183 )
...
* update fastjson2 version, 2.0.2 -> 2.0.3
* update fastjson & druid version
2022-05-23 10:03:41 +08:00
jianghang.loujh
05a52f1bd3
upgrade log4j version
2022-05-20 16:58:20 +08:00
jianghang.loujh
fb0f274ba8
fixed logger
2022-05-20 16:09:53 +08:00
jianghang.loujh
d71a208123
fixed issue #4178 , support -00:00:00.12
2022-05-20 10:37:53 +08:00
jianghang.loujh
656a1d23c2
instance.properties demo
2022-05-19 19:56:50 +08:00
jianghang.loujh
a574b91fdf
fixed #3976 , support LogEvent.MYSQL_TYPE_TYPED_ARRAY
2022-05-19 19:53:54 +08:00
jianghang.loujh
e41e903984
fixed issue #3538 , compatiable mysql8.0 filed meta
2022-05-17 17:17:32 +08:00
jianghang.loujh
4a22d72ef4
fixed issue #4018 , fixed CanalInstanceWithManager thread-safe
2022-05-16 19:46:34 +08:00
jianghang.loujh
b7eff723a3
fixed issue #4027 , CanalServerWithEmbedded.get support newList
2022-05-16 19:41:46 +08:00
jianghang.loujh
9b9cfe4037
fixed issue #4152 , TableMetaTSDB support canal.instance.filter.query.ddl=true
2022-05-16 17:25:43 +08:00
jianghang.loujh
ee51f338e0
fixed outAdapterkey autoGen
2022-05-13 15:13:14 +08:00
zhuchao941 and agapple
4315f203a2
repair issue #3401 ( #3923 )
...
* 解决OutAdapter单例导致的问题,如 1.多个es7 outAdapter的多线程问题(共享同一个es bulk request),2.多个es7 outAdapter共用一份es配置问题
* 1. 优化adapter和监听器之间的代码结构
2. 监听器只处理匹配的配置文件
3. bugfix-es adapter配置文件回调时漏写esVersion
理论上一个adapter实例对应一个config配置文件
Co-authored-by: agapple <jianghang.loujh@alibaba-inc.com >
2022-05-13 15:02:06 +08:00
jianghang.loujh
b12945d4a9
format yml
2022-05-13 14:39:57 +08:00
885f05fb6a
支持定义rocketmq client日志路径,及修复一些bug ( #3229 )
...
* 修复接入阿里云RocketMq no route info for this topic 问题
* 支持deployer同步rocketmq时定义rocketmq client日志路径
* 支持deployer同步rocketmq时定义rocketmq client日志路径
* 回退guava版本号,解决adapter的java.lang.NoSuchMethodError: com.google.common.util.concurrent.MoreExecutors.sameThreadExecutor()异常
* 解决adapter启动报com.alibaba.druid.pool.DruidDataSource cannot be cast to com.alibaba.druid.pool.DruidDataSource异常。
* 支持rocketmq client 配置日志路径
Co-authored-by: hai.yu <hai.yu@snowballtech.com >
Co-authored-by: agapple <jianghang.loujh@alibaba-inc.com >
2022-05-13 14:39:29 +08:00
ChengTie(鐵手)
591126ee6b
update ( #3326 )
2022-05-13 14:37:17 +08:00
He Wang
af432bf10a
fix data truncated for column issue for type year ( #3866 )
2022-05-13 14:33:06 +08:00
jumao
b532e90ff4
ESAdapter Support the same instance cross -library query ( #4161 )
...
* ESAdapter Support the same instance cross -library query
* fix null point ex
2022-05-13 14:31:09 +08:00
xiaoyu.zhang
e48bc35f35
通过索引别名获取mapping,返回数据为真实索引,而不是别名,导致mappings.get(index).get(type)报空指针异常 ( #4122 )
2022-05-13 14:28:53 +08:00
He Wang
11a5f2a0fa
add druid stat filter ( #3985 )
2022-05-13 14:24:37 +08:00
He Wang and agapple
c775478a56
set backtick by DbType ( #3984 )
...
Co-authored-by: agapple <jianghang.loujh@alibaba-inc.com >
2022-05-13 14:23:40 +08:00
He Wang
bd1f91cd9c
fix sync order in RdbMirrorDbSyncService ( #3928 )
2022-05-13 14:19:40 +08:00
jianghang.loujh
67e85d201c
remove client adapter Docker
2022-05-13 12:46:12 +08:00
wanglei
6965726dfe
fix bug #2023 ( #3871 )
...
* fix bug #2023
* 配置canal-adapter,docker生成脚本
2022-05-13 12:39:43 +08:00
willmao
c0001afe8f
use hostname if register name not set ( #3968 )
2022-05-13 12:24:33 +08:00
xiayingfeng
977031a666
Improve MAVEN build Performance ( #4055 )
2022-05-13 12:23:33 +08:00
zhangshaoning
bd3224eea1
Upgrade reference log4j package version ( #4017 )
2022-05-13 12:22:45 +08:00
jianghang.loujh
33733aef25
fixed compatible and code format
2022-05-13 11:59:57 +08:00
zhangjukai
25be0259a4
Some tweaks for pulsarmq-connector ( #4060 )
...
* 1. Add the com.alibaba.otter.canal.connector.core.spi.CanalMsgConsumer file to the META-INF/canal directory under the pulsarmq-connector project
2. Introduce pulsar-client-admin for Canal to automatically create multi-partition topics
3. Add the judgment that roleToken is null
4. The disconnect method in CanalPulsarMQConsumer removes this.pulsarMQConsumer.unsubscribe();, this code will cause data loss during stop
5. When getting Pulsar messages, they are all processed as flat messages, because CanalMessageSerializerUtil.deserializer(data) will deserialize exceptions
6. Use groupId as subscriptName, without the pulsarmq.subscriptName parameter, the entire adapter will be the same subscriber name using pulsarmq.subscriptName
* 逻辑优化
* 代码优化
* 针对pulsar的调整
* 恢复代码
* 恢复代码
* 处理Producer失效的情况
2022-05-13 11:41:50 +08:00
liteng2430
8114d77a20
Add verification: the user can set a password with a length of less than 6 digits when updating the password, but the password length must be greater than or equal to 6 digits when logging in to canal admin, so the length verification function when updating the login password is added ( #4103 )
2022-05-13 11:34:36 +08:00
ZhangJian He
571e7f4e25
fix ojdbc6 wrong corrinator ( #4132 )
2022-05-13 11:33:42 +08:00
温绍锦
ead91433d7
fastjson update 1.x to 2.0.2 ( #4160 )
2022-05-13 11:32:47 +08:00
xiaoma20082008
bac016f89e
<feat>: support visibility columns ( #3976 )
2022-05-13 11:30:19 +08:00
willmao
8804647c30
avoid print password when logging ( #3969 )
2022-05-13 11:28:05 +08:00
mclubing
2623d08b8c
rdb配置不支持yaml后缀文件 ( #3964 )
...
增加rdb配置支持yaml后缀文件
2022-05-13 11:26:04 +08:00
wuare
622fed84ce
fixed logger name ( #3887 )
2022-05-13 11:24:00 +08:00
He Wang
9f5e8fd1c4
rollback guava version in adapter module ( #3880 )
2022-05-13 11:23:30 +08:00
Junwang Zhao
88d472ef1e
move protocol test to protocol test directory ( #3864 )
...
1. move the protocol test to right directory
2. fix wrong string format params count
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com >
2022-05-13 11:16:06 +08:00
Aiden.Ao
2987d08161
fix issue #3144 ( #3712 )
2022-05-13 11:09:09 +08:00
tuple
b54bea5e33
polish the code thus make it more stable ( #3855 )
...
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com >
2021-10-11 14:46:22 +08:00
jianghang.loujh
c42ba95eed
fixed pulsarmq package
2021-10-09 18:06:34 +08:00
jianghang.loujh
b48c434ffd
fixed phoenix version
2021-10-09 17:52:13 +08:00
jianghang.loujh
2c892fce9b
fixed issue #3484 , fixed bat script
2021-10-09 17:39:22 +08:00
jianghang.loujh
3bb49e19d2
fixed issue #3576 , stop exporter
2021-10-09 17:29:23 +08:00
jianghang.loujh
f26b84ffc2
fixed issue #3829 , kafka connector support k8s env
2021-10-09 16:31:59 +08:00
364102729 and agapple
0a2254eeaf
add tablestore adapter ( #3754 )
...
* add tablestore adapter
* add tablestore adapter
* fix bug add add log when etl fail
* fix bug,tinyint(1)以及rowupdatechange
Co-authored-by: agapple <jianghang115@gmail.com >
2021-10-09 16:06:13 +08:00
jianghang.loujh
40d840375f
fixed MR
2021-10-09 15:59:12 +08:00
Chad2li and agapple
5b6fd8094a
增加Apache Pulsar MQ支持 ( #3791 )
...
* done pulsarmq
* del pulsar consumer
* pulsar partition
* done pulsar consumer&connector
* update pulsar-client version to 2.8.1
Co-authored-by: agapple <jianghang115@gmail.com >
2021-10-09 15:51:45 +08:00
mikoto
4ce401d219
fix: 多destination的场景下只能生效一个 ( #3772 )
2021-10-09 15:38:26 +08:00
Jonathan Schneider and Moderne
de95a6a128
refactor: Use Java standard library instead of Guava ( #3708 )
...
Co-authored-by: Moderne <team@moderne.io >
Co-authored-by: Moderne <team@moderne.io >
2021-10-09 15:33:37 +08:00
happyrita
9e11c3c018
定时保存snapshot到DB的逻辑中,schema名称获取错误,在有配置canal.instance.filter.regex时,由于对应的table无法被匹配中,导致compareTableMetaDbAndMemory方法不被执行 ( #3693 )
...
* 避免重复订阅zk变更状态
* Update DatabaseTableMeta.java
获取schema的名称
* Update CanalController.java
2021-10-09 15:32:20 +08:00
arthasking123
d67bea8f3d
repair issue #3678,#3680 ( #3684 )
...
* repair issue #3678,#3680
* repair issue #3678,#3680
2021-10-09 15:30:32 +08:00
kkjinping
997957d6e0
新增配置 canal.mq.enableDynamicQueuePartition,获取topic对应的队列的数量为分区的数量,以支持动态队列的场景(如阿里云的rocketmq,无法人工设置队列数量,可能会动态伸缩) ( #3670 )
2021-10-09 15:26:23 +08:00
tanpenggood
ea20076a32
fix: rowChange typo ( #3593 )
2021-10-09 15:23:36 +08:00
dinosaur
2550d8eb65
Connection is already closed fix ( #3587 )
2021-10-09 14:54:05 +08:00
nick
31a0fdc807
add note ( #3550 )
2021-10-09 14:53:28 +08:00
lanicc
d79431c7e5
fix typo ( #3532 )
2021-10-09 14:53:00 +08:00
ruanjl
911711248c
修复rds高可用主从切换和oss相关问题 ( #3480 )
...
* 修复rds oos 拉取的binlog 的消费逻辑以及本地消费到直连消费的逻辑衔接
* 去除无用代码
2021-10-09 14:51:41 +08:00
spark and lihuav2017
63407dc570
canal adapter phoenix ( #3290 )
...
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
* canal adapter phoenix
Co-authored-by: lihuav2017 <lihua@able-elec.com >
2021-10-09 14:37:11 +08:00
flowell
3c20fd09ad
fix issue #3839 : 修复alter table character set类型DDL语句解析BUG ( #3840 )
2021-10-09 14:28:56 +08:00
ChenZhangg and Chen Zhang
eef3bd92ba
Improve MAVEN build Performance ( #3851 )
...
Co-authored-by: Chen Zhang <340355960@qq.com >
2021-10-09 14:26:26 +08:00
agapple
474063af3b
fixed issue #3494 , polardb-x 2.0 cdc support implicit_id/varaibles
2021-04-28 13:42:55 +08:00
agapple
5cc85ff2de
[maven-release-plugin] prepare for next development iteration
2021-04-19 15:48:20 +08:00
agapple
64862503ba
[maven-release-plugin] prepare release canal-1.1.5
2021-04-19 15:48:09 +08:00
agapple
f9e0dc7daa
fixed testcase
2021-04-19 15:15:10 +08:00
agapple
0c399509a9
upgrade druid 1.2.6
2021-04-19 12:57:21 +08:00
agapple
a09cd9adb5
fixed issue #3110 , json escapse
2021-04-19 11:28:45 +08:00
agapple
1369418c6a
fixed code format & merge
2021-04-19 10:55:43 +08:00
995586041
75174a63af
增加rabbitmq消息持久化deliveryMode配置 ( #3300 )
2021-04-19 10:29:23 +08:00
zoemak
17f4ee13e7
自动注册时可自定义node server名称,canal.properties#canal.admin.register.name,为空则使用canal.register.ip ( #3459 )
2021-04-19 10:18:01 +08:00
Fei Yang
f0417502f8
fix: unit_present typo ( #3461 )
...
https://github.com/alibaba/canal/issues/3434
2021-04-19 10:16:17 +08:00
renyansongno1
a7720b51e4
支持rocketmq的消息按照tag去发送 ( #3438 )
...
* 支持rocketmq的消息按照tag去发送
并对应修改了配置文件
* 将tag的设计转移到Rocketmq的单独配置项
2021-04-19 10:14:27 +08:00
suman-lee
21904ef1dc
基于明确的I/U/D是否过滤 ( #3452 )
...
* dmls filter
* dmls filters
* 基于明确的I/U/D是否过滤
* 基于明确的I/U/D是否过滤
2021-04-19 10:10:54 +08:00
agapple
94425223bd
fixed issue #3454 , concurrent env bugfix
2021-04-17 10:57:25 +08:00
agapple
7857df9701
add sql parser testcase
2021-04-17 10:49:17 +08:00
agapple
64ea4ff222
fixed issue #3267 , fixed rockemq send null message
2021-04-17 10:25:49 +08:00
agapple
85df89f777
fixed issue #3377 , escapse schema name
2021-04-16 23:11:41 +08:00
AlphaKitty
a0f8e182ec
修复当host中存在冒号(比如https:)抛UnknownHostException问题 ( #3223 )
...
* 修复当host中存在冒号(比如https:)抛UnknownHostException问题
* 更优雅地解析url
2021-04-16 22:11:21 +08:00
温绍锦
33721d0394
update druid version ( #3146 )
...
* replace fastsql with druid
* update druid version
2021-04-16 22:09:40 +08:00
Treeyh and hai.yu
91bddfeed6
修复接入阿里云RocketMq no route info for this topic 问题 ( #3220 )
...
Co-authored-by: hai.yu <hai.yu@snowballtech.com >
2021-04-16 22:08:28 +08:00
16075140
25feab4af8
support rabbitmq port by config ( #3236 )
2021-04-16 22:07:12 +08:00
binbin
f66baeabf1
修复最近位置被remove掉,导致重复消息的问题 ( #3276 )
2021-04-16 22:03:51 +08:00
agapple
b1dc3821ea
fixed config url auth
2021-04-16 21:52:23 +08:00
Jump-Boy
f5f79104eb
fix centos 6.10 yum bug and update jdk8.rpm download url ( #3398 )
2021-04-16 21:41:55 +08:00
ltamber
e8d138d3bd
fix: uuidset combine fix ( #3432 )
2021-04-16 21:37:55 +08:00
zoemak
32d9e58915
升级rocketmq到4.8.0,并且支持环境变量优先配置 ( #3450 )
2021-04-16 21:35:11 +08:00
许道杰
58448e559d
fix: issue #2649 client-adapter启动时抛LinkageError异常、#3073 client-adapter通过启动参数传入canal.tcp.zookeeper.hosts为空值时抛异常 ( #3074 )
2021-04-16 21:25:14 +08:00
许道杰
fede3b3d1d
fix #3126 将hbase-client依赖修改为hbase-shaded-client ( #3127 )
2021-04-16 21:24:44 +08:00
许道杰
5d8ec31bc4
fix #3119 ( #3121 )
2021-04-16 21:22:31 +08:00
WangCong
82b18ebe62
feat unsigned bug ( #3104 )
2021-04-16 21:17:43 +08:00
hupeng
66408782b0
process()方法中,在retry循环中处理成功应该break ( #3080 )
...
process()方法中,在retry循环中处理成功应该break
2021-04-16 21:14:43 +08:00
许道杰
846c8870ae
fix: issue #3076 ( #3077 )
2021-04-16 21:12:12 +08:00
ljcoder and liguowang
8cfb07f07e
数据库名称如何存在中划线"-"情况下,SQL执行异常 ( #3228 )
...
Co-authored-by: liguowang <liguowang@aerozhonghaun.com >
2020-12-31 11:33:01 +08:00
文哥
d741425895
升级guava 至 22.0 ( #3184 )
...
* fix issue:#561 增加一个外部参数控制,允许位点不存在时自动重置到当前位点
* Add MariaDB GTID support
* remove client pom bad ns
* upgrade guava version to 22.0
2020-11-20 13:47:26 +08:00
文哥
20add85ff6
统一Canal 依赖的Spring 版本,升级ibatis 至mybatis ( #3182 )
...
* fix issue:#561 增加一个外部参数控制,允许位点不存在时自动重置到当前位点
* Add MariaDB GTID support
* 1. fix maven central repository url access error.(Update to https)
2. upgrade spring version to 5.0.5.RELEASE
3. upgrade ibatis to mybatis
* fix unit test run error
2020-11-20 09:24:56 +08:00
agapple
a5c09c521e
Update README.md
2020-11-02 12:54:54 +08:00
agapple
c94276b1ac
Update README.md
2020-11-02 12:53:35 +08:00
agapple
272d575c78
Update README.md
2020-11-02 12:44:59 +08:00
温绍锦
693f8d501a
replace fastsql with druid ( #3132 )
2020-10-31 13:19:03 +08:00
温绍锦
bb1b6b9862
Update README.md
2020-10-23 14:41:31 +08:00
温绍锦
8ed82caaef
Update README.md
2020-09-29 16:18:23 +08:00
文哥
de1dd70609
1. Add MariaDB gtid support 2. fix issue:#561 增加一个外部参数控制,允许位点不存在时自动重置到当前位点 ( #3025 )
...
* fix issue:#561 增加一个外部参数控制,允许位点不存在时自动重置到当前位点
* Add MariaDB GTID support
2020-09-24 17:56:40 +08:00
zavakid
09429c241f
= inner class MessageEventFactory to be static
2020-09-23 11:37:17 +08:00
zavakid
9a332940d7
= remove unused import
2020-09-23 11:34:45 +08:00
zavakid
362974b1c2
= code cleanup: remove unnessary boxing
2020-09-18 00:54:23 +08:00
zavakid
435db30b7b
= performance improve
...
- using bulk operation instead of iteration if possible
- terminate loop after condition is met
2020-09-18 00:51:53 +08:00
zavakid
e7de8289cd
= code cleanup : modified inner class to 'static' if possible
2020-09-18 00:49:48 +08:00
zavakid
5065fea963
= fix BooleanMutex's inner Sync to static class and add test case
2020-09-18 00:44:25 +08:00
zavakid
6989eb3d2b
+ fix logging call placeholders number
2020-09-17 23:26:02 +08:00
zavakid
df24596092
= code cleanup
...
- for loop replaceable with enhanced 'for' loop
- using diamond in generic type
- collapse try catch exception
- using try-with-resource
- using List#sort instead of Collections#sort
- replaced lambda with method reference
- using native compare method to compare numbers
- using switch instead of if for in ESSyncUtil
2020-09-17 23:22:25 +08:00
zavakid
43c23ffb97
= remove unused improt
2020-09-17 22:40:06 +08:00
zavakid
e7658879bc
= cold cleanup
...
* using lambda if possible (we are already building in Java8)
* using diamond when new generic instance
* remove used improt
2020-09-17 17:46:20 +08:00
zavakid
df60eda679
= code cleanup
2020-09-16 14:18:05 +08:00
liguangyao
b81e9dfeb8
支持不同topic指定专属partitionNum ( #2479 )
2020-08-22 13:11:53 +08:00
agapple
b79af46054
merge code and fixed issue #2755 #2756 #2735 #2714 #2711 #2710 #2616 #2602 #2585 #2565 #2935 #2434 #2623 #2418 #2387
2020-08-22 13:07:24 +08:00
calvinhkf
90bf9e6de5
align h2 version to 1.4.196 ( #2663 )
2020-08-20 21:19:22 +08:00
zhaohua
182163c3bd
MemoryTableMeta ddl 处理注释2 ( #2694 )
...
* MemoryTableMeta ddl 处理注释
* MemoryTableMeta ddl 处理注释2
2020-08-20 21:19:08 +08:00
dengliming
e4726972de
refactor: delete duplicate code ( #2748 )
2020-08-20 21:18:51 +08:00
dengliming
985892cf7e
Remove deprecated sudo setting. ( #2749 )
2020-08-20 21:18:37 +08:00
chank
746d51e621
Change maven repository to HTTPS ( #2763 )
...
* change maven repository to https
* change maven repository to https
2020-08-20 21:18:25 +08:00
caoyixiong
cdd077b758
FIX NPE When ddl event ( #2801 )
2020-08-20 21:18:12 +08:00
DinoZhang
72ae7ba8d7
meta admin ( #2836 )
2020-08-20 21:18:00 +08:00
Tocker
b82c8bca83
Fix:Alibaba Coding Guidelines-Object的equals方法容易抛空指针异常,应使用常量或确定有值的对象来调用equals。 ( #2919 )
2020-08-20 21:17:44 +08:00
Tocker
576406a4ce
Fix:Alibaba Coding Guidelines-所有的包装类对象之间值的比较,全部使用equals方法比较 ( #2918 )
2020-08-20 21:17:32 +08:00
Ymangz
b5b08e92e3
Unbuntu 20.0 默认sh为dash执行时会报语法异常 ( #2939 )
2020-08-20 21:17:11 +08:00
wanshao
9f6021cf36
fix(dml): revert wrong fix
2020-03-13 17:41:53 +08:00
bucketli
0e3d719a39
refact(canal):duplicate dependence
2020-03-09 14:15:40 +08:00
agapple
afbf125231
fixed format
2020-03-05 15:26:59 +08:00
agapple
b2b2a82554
client-adapter 写入kudu ( #2396 )
...
* client-adapter 提交写入kudu适配器
* kudu etl 处理数据缓存提交问题
* Update KuduTemplate.java
* 1.写入kudu前获取元数据方式更改
2.解决etl批量导入kudu数据少量丢失问题
* 1.修改文件头注释
2.调整kudu更新事件update为upsert
2020-03-05 15:22:01 +08:00
wanshao
30a1b067a8
fix(project): no need to process tinyint(1) specially #631
2020-02-28 14:34:30 +08:00
wanshao
beaca165d0
Merge branch 'master' of github.com:alibaba/canal
2020-02-28 14:24:33 +08:00
wanshao
c21c18458b
fix(project): fix isDdl judge #2599
2020-02-28 14:21:12 +08:00
agapple
5e761e14fa
format
2020-02-28 13:15:27 +08:00
agapple
18418ebd98
merge pull/2120
2020-02-28 12:29:41 +08:00
844392610
92f04f86cb
添加目标表不区分大小写的支持,并可开关(默认为区分大小写) ( #2329 )
...
* 添加目标表不区分大小写的支持,并可开关(默认为区分大小写)
* 添加目标表不区分大小写的支持,并可开关(默认为区分大小写)-format
2020-02-28 12:22:17 +08:00
littleneko
0d5505aa2c
fix_json_type_opaque_parse_err ( #2318 )
...
对于`JSONB_TYPE_OPAQUE`类型的解析计算`q_max_bytes`时,多算了`1`字节
2020-02-28 12:15:09 +08:00
zhshy11
bd56438eca
sql语句增加引号,兼容mysql关键字 ( #2358 )
2020-02-28 11:47:38 +08:00
agapple
b9a157657f
merge /pull/2373
2020-02-28 11:46:28 +08:00
agapple
523e8b85e6
format
2020-02-28 11:40:14 +08:00
agapple
ab74b2c82c
fixed mq spi package
2020-02-28 11:32:30 +08:00
rewerma
265a8e8594
模块化mq connector ( #2562 )
...
* add connector module, add kafka producer connector module for server
* add rocketMQ producer connector module for server
* add rabbitMQ producer connector module for server
* optimize code, add annotation
* add canal message consumer connector for canal-adapter module
2020-02-28 11:00:08 +08:00
jianqingdu
4fc7e5f7d9
fix bug: wrong quit command implementation ( #2554 )
2020-02-28 10:52:35 +08:00
Li Qiang
9cc8caa834
feature(canal):support start with timestamp position(empty journal_file,set position=0),#2594 ( #2595 )
2020-02-28 10:50:38 +08:00
Li Qiang
a71375dad5
fix(canal):fix endless local binlog mode with exception. ( #2597 )
2020-02-28 10:48:54 +08:00
Rg
70d8a379f2
add Rust canal client support ( #2518 )
2020-01-15 20:12:28 +08:00
rewerma
b6333f018f
Revert "修复kafka消费回滚的bug ( #2521 )" ( #2526 )
...
This reverts commit 31acfc0101 .
2020-01-02 17:04:57 +08:00
rewerma
31acfc0101
修复kafka消费回滚的bug ( #2521 )
2020-01-02 16:15:47 +08:00
rewerma
6d9ea57186
修复子线程阻塞造成不能中止的问题 ( #2508 )
2019-12-26 19:29:48 +08:00
Li Qiang
c4c0255073
Update README.md
2019-11-04 10:20:00 +08:00
agapple
1fa9020599
format
2019-10-15 21:38:48 +08:00
agapple
dd7554374f
format
2019-10-15 21:35:57 +08:00
shicongyang
65b5325ca6
建议增加一个属性,针对根据某一字段hash时,hash算法可以不根据database算出 #2248 ( #2294 )
2019-10-15 21:32:42 +08:00
agapple
b64a3e301a
fixed issue #2286 , ArithmeticException zero
2019-10-10 15:37:17 +08:00
agapple
31562919bb
rename canal-admin project to admin
2019-10-09 14:50:08 +08:00
agapple
9c75e25da7
optimizer pom dependency
2019-10-09 14:18:37 +08:00
agapple
7d91850be6
fixed issue #2257 , time 100 parse bugfix
2019-10-09 13:39:22 +08:00
agapple
4af3b24b69
fixed issue #2281 , null reject
2019-10-08 18:50:37 +08:00
craigwu9
e4e66b143c
make canal.admin.port canal.admin.user canal.admin.passwd can be override by system env properties ( #2274 )
...
* Update SimpleAdminConnectors.java
add more information about which server execute failed
* Update CanalStarter.java
make canal.admin.port canal.admin.user canal.admin.passwd can be override by system env
2019-09-30 20:45:00 +08:00
agapple
dd93e2b0c4
fixed issue #2258 , optimizer rabbitmq send perf & matchTopics only match one Topic
2019-09-30 20:42:52 +08:00
agapple
d505b5ab9d
fixed issue #2258 , optimizer rocketmq send perf
2019-09-30 20:19:25 +08:00
agapple
0fb717a97f
fixed issue #2258 , optimizer kafka send perf
2019-09-30 14:24:59 +08:00
一杯Hash
c634f98fca
bugfix mysql >= 8.0, 缓存层移除,EbeanServer 运行 Fail,Unknown system variable query_cache_size error! ( #2264 )
...
threw exception; nested exception is javax.persistence.PersistenceException: java.sql.SQLException: Unknown system variable 'query_cache_size'
2019-09-29 10:51:17 +08:00
rewerma
460479390a
bug fix ( #2249 )
2019-09-26 10:58:28 +08:00
Li Qiang
26013e239d
Update README.md
2019-09-25 19:49:22 +08:00
agapple
46fe40ed47
use es6x/es7x instead of elaticsearch project
2019-09-25 19:31:52 +08:00
Koshoooooo
0c27bcf73e
Fix issue #2221 ( #2242 )
...
fastjson修复了拒绝服务安全问题,升级到当前1.2.58的兼容安全版本1.2.58.sec06
2019-09-25 19:28:13 +08:00
agapple
d86b0e6e67
fixed testcase
2019-09-25 19:16:33 +08:00
EdgarScott
fff623acb1
Add unit tests ( #2235 )
...
* Add Unit Tests for the following classes:
com.alibaba.otter.canal.client.adapter.support.JdbcTypeUtilTest
com.alibaba.otter.canal.client.adapter.support.UtilTest
com.taobao.tddl.dbsync.binlog.JsonConversion_Json_ValueTest
com.taobao.tddl.dbsync.binlog.JsonDiffConversionTest
com.taobao.tddl.dbsync.binlog.LogBufferTest
com.taobao.tddl.dbsync.binlog.LogEventTest
com.taobao.tddl.dbsync.binlog.event.LogHeaderTest
com.taobao.tddl.dbsync.binlog.event.RowsLogBufferTest
com.alibaba.otter.canal.parse.driver.mysql.packets.client.RegisterSlaveCommandPacketTest
com.alibaba.otter.canal.parse.driver.mysql.utils.ByteHelperTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DdlResultTest
com.alibaba.otter.canal.parse.inbound.mysql.ddl.DruidDdlParserTest
These tests were written using Diffblue Cover
* Add dependencies and refactor
2019-09-25 18:53:24 +08:00
rewerma
f45c0206da
Add elasticsearch 7.x version adapter support ( #2246 )
...
* init es data sync upgrade
* Add elasticsearch 7.x version adapter support
2019-09-25 18:51:34 +08:00
gaecfov
61726c7e05
fix: ES配置文件监控问题 ( #2202 )
...
* fix:
ES监控配置文件时如果第一次因为文件错误新增失败后,再次修改不会新增的问题
ES监控配置文件添加的Config缓存没有带Instance导致匹配不到的问题
* fix:ES配置文件监控不生效
2019-09-17 09:22:55 +08:00
耐小心
79552e0a37
rabbitmq(amqp)MQ支持 ( #2156 )
2019-09-16 12:43:02 +08:00
agapple
5ec2087257
fixed issue #2197 , startup.bat fix
2019-09-16 09:58:27 +08:00
rewerma
5214257cd4
ES子表含group的where条件拼接 ( #2190 )
...
* ES子表含group的where条件拼接
* modify
2019-09-16 09:47:02 +08:00
gaecfov
365ca4d01f
fix:当查询列包含常量拼接时解析主键字段进行条件拼接时会多出 where null=null ( #2188 )
2019-09-16 09:44:59 +08:00
agapple
419a73b3de
fixed issue #2168 , ignore create database
2019-09-12 09:08:30 +08:00
Jony
c093fbb8f6
动态刷新同步锁状态 ( #2181 )
...
* 解决修改数据库远程配置,canal-adapter 一直循环destroy、init。
* 解决动态添加instance和对应的adapter无锁状态问题。
2019-09-12 08:52:33 +08:00
rewerma
31bb85bea3
fix bug #2023 and code optimize ( #2167 )
...
* 减少等待刷新状态时间
* fix bug #2023
2019-09-12 08:47:22 +08:00
rewerma
803565456f
fix modified_time null value error ( #2157 )
...
* template config load
* compile vue frontend for product
* fix modified_time null value error
* modify
2019-09-07 21:53:11 +08:00
Li Qiang
520f5771d8
Update README.md
2019-09-06 15:02:34 +08:00
Li Qiang
5fbd6f6606
Update README.md
2019-09-06 14:57:47 +08:00
Li Qiang
bc9c7f0f1d
Update README.md
2019-09-06 14:54:22 +08:00
Li Qiang
08a2f0aa44
Update README.md
2019-09-06 14:45:33 +08:00
Li Qiang
a0387faa67
Update README.md
2019-09-06 14:45:14 +08:00
Li Qiang
1dd4674ccb
Update README.md
2019-09-06 13:36:04 +08:00
Jony
60e26d1ddd
解决修改数据库远程配置,canal-adapter 一直循环destroy、init。 ( #2137 )
2019-09-04 12:25:54 +08:00
agapple
ecdab76705
fixed issue #2129 , Negative seek offset
2019-09-03 08:51:21 +08:00
agapple
403fdf997c
Update README.md
2019-09-02 19:28:49 +08:00
agapple
a9e83463e0
Update README.md
2019-09-02 19:27:50 +08:00
agapple
2bde4327c7
[maven-release-plugin] prepare for next development iteration
2019-09-02 14:24:16 +08:00
agapple
d53bfd7ee7
[maven-release-plugin] prepare release canal-1.1.4
2019-09-02 14:24:03 +08:00
agapple
ccc45b672c
fixed issue #2127 , remove logback stdout
2019-09-02 14:10:29 +08:00
agapple
0d42bdafe2
fixed stdout
2019-09-02 14:04:19 +08:00
agapple
95050ff382
fixed test example
2019-09-02 13:46:35 +08:00
agapple
5addd246ac
fixed unused error
2019-09-01 11:20:00 +08:00
agapple
cfc95e2b7a
fixed docker config
2019-09-01 10:41:00 +08:00
agapple
44187d9e3a
fixed docker config
2019-09-01 10:15:58 +08:00
agapple
c76e8ba0e4
fixed canal-admin
2019-08-31 15:23:58 +08:00
rewerma
1bcae9dc49
template config load ( #2123 )
...
* template config load
* compile vue frontend for product
2019-08-31 14:56:28 +08:00
agapple
3a388308d9
fixed compiler error
2019-08-31 13:01:52 +08:00
agapple
a60ec6fa42
fixed tescase failed
2019-08-31 13:00:31 +08:00
agapple
456945fe3a
add autoRegister and cluster
2019-08-31 12:59:12 +08:00
agapple
ba24c15833
add conflict file
2019-08-31 12:47:27 +08:00
agapple
4e0b8a0278
fixed admin
2019-08-31 12:24:41 +08:00
rewerma
274e91f8aa
bug fix ( #2122 )
...
* admin端口调整完成
* server端适配调整
* 调整部分功能
* 单机/集群admin调试完成
* 重新发布前端页面
* bug fix
* 解决server端admin配置会被远程覆盖的问题
解决default-instance.xml无法加载远程zkServers配置的问题
* 集群模式下取活动实例的问题
2019-08-31 12:22:16 +08:00
rewerma
89055f7405
canal-admin完善 ( #2121 )
...
* admin端口调整完成
* server端适配调整
* 调整部分功能
* 单机/集群admin调试完成
* 重新发布前端页面
2019-08-30 18:09:22 +08:00
rewerma
e8dba41216
code optimize ( #2108 )
...
* code optimize
2019-08-27 22:52:14 +08:00
agapple
f52b2cccd5
fixed testcase
2019-08-27 22:45:27 +08:00
rewerma
7386327af9
code optimize ( #2107 )
...
* admin assembly打包
* 修改npm profile
* code optimize
* code optimize
2019-08-27 22:24:53 +08:00
rewerma
c48407b449
修改npm profile ( #2106 )
...
* admin assembly打包
* 修改npm profile
2019-08-27 20:55:15 +08:00
rewerma
d92badeb45
admin assembly打包 ( #2104 )
2019-08-27 19:48:22 +08:00
agapple
7093179cc8
fixed issue #2099 , rename poll to polling
2019-08-27 16:25:42 +08:00
agapple
bf89974f7c
fixed issue #2099 , support remote config poll
2019-08-27 16:11:20 +08:00
rewerma
2e1b7a5093
通过http从canal-admin中拉配置 ( #2093 )
...
* modify
* http拉取配置监听
* revert main pom
* 整理代码
2019-08-26 19:01:08 +08:00
agapple
3d4dbc9a8c
fixed issue #2099 , support user/passwd acl and canal admin operator
2019-08-26 18:16:33 +08:00
agapple
e376a129ed
fixed canal-admin vue
2019-08-24 16:54:27 +08:00
wangwengeek
983ff5fc73
查询数据过长变成byte数组转化为json解决 ( #2090 )
...
Caused by: com.alibaba.fastjson.JSONException: syntax error, pos 2, json : [B@406b7f2 #2089
2019-08-23 17:38:22 +08:00
agapple
3a74f6124a
fixed issue #1940 #2088 , add canal.register.ip support docker
2019-08-22 23:48:19 +08:00
agapple
bd974e3da8
upgrade fastjson 1.2.58
2019-08-22 23:03:22 +08:00
agapple
86cd805a64
upgrade fastsql 973
2019-08-22 22:02:58 +08:00
agapple
8b54b9e596
add python client info
2019-08-22 15:17:33 +08:00
agapple
2d3baeab7d
fastsql tsdb testcase
2019-08-22 15:08:36 +08:00
黄大海
7b245c5a64
fix #1762 ( #1959 )
2019-08-21 14:33:31 +08:00
agapple
78af6b1130
fixed issue #2067 , add example
2019-08-21 13:52:34 +08:00
ever
7547cac3c5
fix compiler problem: upgrade rocketmq to 4.5.2 ( #2074 )
2019-08-21 12:48:46 +08:00
soocold
066743cfd6
always check whether ringbuffer has an exception in event processor ( #2053 )
2019-08-21 12:46:17 +08:00
rewerma
fdd0763567
新增es adapter rest client和认证机制 ( #2046 )
...
* 新增es adapter rest client和认证机制
* 修改getMapping位置
* 代码调整
* 代码调整
* 整理代码
* fix #2048
2019-08-21 12:44:57 +08:00
ThomasPerkins1123
bcdbf75dc5
Add unit tests for com.alibaba.otter.canal.parse.driver.mysql.utils.ByteHelper ( #2039 )
...
These tests were written using Diffblue Cover.
2019-08-21 12:44:24 +08:00
jason-liew
db23f15b61
fix: hbase etl sql syntax error in some case ( #2034 )
2019-08-21 12:44:04 +08:00
rewerma
44722fe01c
canal-admin-ui 指定profile编译 ( #2019 )
...
* canal-admin-ui 指定profile编译
* 启动实例时选择指定节点
* modify
* modify
* 静态页面修改
2019-07-22 09:15:14 +08:00
bucketli
be9813142f
remove openjdk12
2019-07-20 19:05:49 +08:00
bucketli
c48e80a163
remove oraclejdk8 CI config,add oraclejdk12 and openjdk12
2019-07-20 18:34:01 +08:00
bucketli
c1bfad4f2d
1.not compile canal-admin module,unless you need it, to be optimize.#1998,2.support JDK 11 & 12 ,3.fix the CI block test
2019-07-20 18:12:07 +08:00
rewerma
10f4ef6acd
canal admin ( #1998 )
...
* 增加注解
* modify
* 文件大小写问题
2019-07-16 21:47:53 +08:00
Li Qiang
4c0d82fb98
Update README.md
2019-07-16 20:35:37 +08:00
rewerma
7cec0994e9
Merge branch 'master' into master
2019-07-14 19:24:42 +08:00
mcy
483044916d
canal admin
2019-07-14 19:18:15 +08:00
mcy
c8bb6e200c
modify
2019-07-14 09:59:58 +08:00
mcy
9cc6b67426
ddl sql
2019-07-14 09:59:35 +08:00
mcy
62072ea9ab
modify
2019-07-14 00:06:25 +08:00
mcy
f3daceea6b
canal instance manager module finished
2019-07-13 21:34:44 +08:00
rewerma
4efc0f6078
modify
2019-07-13 18:03:28 +08:00
rewerma
40d2a8c6cc
modify
2019-07-13 14:33:42 +08:00
rewerma
28da536ec8
modify
2019-07-13 11:47:55 +08:00
mcy
6f129bf524
modify
2019-07-12 21:00:33 +08:00
mcy
31ae308760
增减jmx状态控制
2019-07-12 20:59:20 +08:00
mcy
c2ce662f9a
modify
2019-07-12 20:08:16 +08:00
mcy
7044e172f5
jmx 客户端
2019-07-12 20:06:58 +08:00
Menng
c070757da0
修正文档链接&优化格式 #1965 ( #1967 )
2019-07-12 10:13:29 +08:00
xingwenge
92dd2bb189
Update README.md ( #1981 )
2019-07-12 09:53:06 +08:00
rewerma
8639b45fe9
fix #1761 ( #1973 )
...
* Message转Dml对null值的判断
* Message转Dml对null值的判断
* Message转Dml对null值的判断
* fix #1761
2019-07-12 09:52:36 +08:00
mcy
6b9487a0a0
modify
2019-07-12 09:16:10 +08:00
rewerma
5741f5a347
modify
2019-07-12 00:42:18 +08:00
rewerma
4c3ef6772c
modify
2019-07-12 00:01:37 +08:00
rewerma
64824bc5aa
modify
2019-07-11 23:29:49 +08:00
mcy
23209f24ed
增减jmx状态控制
2019-07-11 21:34:12 +08:00
mcy
015026ea91
modify
2019-07-11 21:31:38 +08:00
mcy
c7967e989c
modify
2019-07-11 20:46:02 +08:00
mcy
e4b37f33de
modify
2019-07-11 20:44:39 +08:00
mcy
598f15a404
modify
2019-07-11 16:30:50 +08:00
mcy
ec5f1eb10d
modify
2019-07-11 16:16:32 +08:00
mcy
28c0aac98d
modify
2019-07-11 15:11:29 +08:00
mcy
50ea6870dc
modify
2019-07-11 15:07:57 +08:00
mcy
317439670c
modify
2019-07-11 10:16:12 +08:00
rewerma
64ff140304
modify
2019-07-11 01:05:11 +08:00
rewerma
a93af74539
modify
2019-07-11 00:20:56 +08:00
rewerma
fc39b2af68
modify
2019-07-10 21:46:38 +08:00
mcy
e87a0c3b63
canal-admin init
2019-07-10 16:22:38 +08:00
mcy
b43043f4e4
Merge remote-tracking branch 'origin/master'
2019-07-09 19:09:24 +08:00
mcy
60a46ae941
fix #1761
2019-07-09 19:08:35 +08:00
Braavos
b5c05c2fd2
Add unit tests for com.alibaba.otter.canal.parse.driver.mysql.utils.MySQLPasswordEncrypter ( #1937 )
...
These tests were written using Diffblue Cover.
2019-06-28 14:57:18 +08:00
靳光宇
0cf18976d9
Update HbaseSyncService.java ( #1936 )
...
Fix batch update or delete with only affects the first data issue
2019-06-28 14:56:51 +08:00
Li Qiang
803c0607d3
Update README.md
2019-06-27 19:45:26 +08:00
Li Qiang
f04e742f4f
#1897 , fix DummyEventStore implements new method ( #1932 )
2019-06-27 09:58:24 +08:00
cjk87927
c81034dda3
增加表字段过滤功能 ( #1914 )
...
* 增加表字段过滤功能
* 增加表字段过滤功能
* 更换fastsql版本通过编译
* 1.修改字段配置格式 2.增加字段黑名单配置(冲突时以白名单为准)
2019-06-26 17:45:14 +08:00
agapple
a847660a45
fixed issue #1826 , remove kafka transaction send
2019-06-26 16:02:19 +08:00
agapple
4957083493
fixed issue #1897 , memory event store ack null
2019-06-25 17:32:46 +08:00
rewerma
24f0eece42
Merge pull request #1 from alibaba/master
...
merge
2019-06-19 21:00:31 +08:00
agapple
adccc0e912
add logger info for query_log_event
2019-06-19 15:04:22 +08:00
agapple
8728beb4b6
fixed compile
2019-06-18 22:18:30 +08:00
agapple
5bea876ec9
fixed issue #1352 , add pkNames for flatMessage partition
2019-06-18 21:44:52 +08:00
agapple
6c494f8892
add rocketmq-client pom version
2019-06-18 21:28:55 +08:00
BillowX
74489d1bba
当MQ配置为Kafka时,支持配置Kerberos认证 ( #1895 )
2019-06-18 15:02:14 +08:00
Z6N
5ac0f7b710
按主键散列,未设置主键时无限空指针异常 ( #1889 )
...
当按注解散列时,如果监控的表未显示设置主键,将会导致flatMessage.getPkNames()为空,导致无限空指针异常
2019-06-18 15:01:00 +08:00
lanxinxu
75b4911caf
线程安全的获取meta ( #1866 )
2019-06-18 14:59:30 +08:00
lanxinxu
95602f4784
并行解析模式下有丢数据风险 ( #1857 )
2019-06-18 14:57:59 +08:00
agapple
058e1fc546
fixed delete message send mq bugfix
2019-05-28 00:14:20 +08:00
lulu2panpan
e808c6ec70
AbstractCanalInstance的subscribeChange方法,增加对AbstractEventParser的类型判断;MysqlEventParser对Gtid的处理需要考虑兼容性 ( #1824 )
...
* AbstractCanalInstance的subscribeChange方法,增加对AbstractEventParser的类型判断,以支持用户的自定义CanalEventParser
* MysqlEventParser对Gtid模式的处理需要考虑兼容性,支持系统平滑的从非gtid模式升级为gtid模式
2019-05-28 00:05:13 +08:00
rewerma
ce7948d6e7
fix Message转Dml对null值的bug ( #1808 )
...
* Message转Dml对null值的判断
* Message转Dml对null值的判断
* Message转Dml对null值的判断
2019-05-28 00:03:55 +08:00
soso
8df6d6fed8
Fix: 主备切换后没有往Kafka发送数据 ( #1810 )
...
发生主备切换时,调用canalMQStarter启停对应的destination。
2019-05-28 00:03:28 +08:00
nieyuan1991
f9989e0856
fix:未捕获kafka事务异常,造成canal ack异常 ( #1814 )
2019-05-28 00:02:25 +08:00
xiayuan
4075a0623f
set the validationQuery while testWhileIdle is true ( #1827 )
2019-05-27 23:56:25 +08:00
Marsss___
37fc248ebf
删除操作计算hash值的情况没有考虑,导致删除时的分区和插入时的分区不一致 ( #1848 )
2019-05-27 23:54:25 +08:00
Heng Du
d0a83aad27
Support seamless docking with Alibaba Cloud RocketMQ commercial service ( #1849 )
2019-05-27 23:51:32 +08:00
agapple
3b9ff26d1a
add logo
2019-05-15 10:20:08 +08:00
mcy
4f7842c843
Message转Dml对null值的判断
2019-05-14 17:38:01 +08:00
mcy
b870e7ecd0
Message转Dml对null值的判断
2019-05-14 17:35:34 +08:00
mcy
331dd63c5f
Message转Dml对null值的判断
2019-05-14 17:31:51 +08:00
JKTerrific
72c4daba5f
1:添加对于查询结果中,MAX( CASE a.key WHEN 'WORD1' THEN a.value ELSE 0 END ) AS… ( #1794 )
...
* 1:添加对于查询结果中,MAX( CASE a.key WHEN 'WORD1' THEN a.value ELSE 0 END ) AS WORD1 的竖表转横表的支持
2:添加对于查询条件尾部,使用GROUP BY _id 等分组语句时出现的sql解析异常问题
* fix index out of range
2019-05-11 17:33:59 +08:00
Jet
7427a74612
improve es etl ( #1758 )
...
* fix typo in trace log
* improve es etl
* improve es etl log
* improve es etl by add threadCount
* improve es etl by add threadCount
* improve es etl query
* remove comment
2019-05-11 17:26:08 +08:00
paascloud
24fae6fa52
变量定义错误 ( #1776 )
...
* 变量定义错误
* 变量定义错误
2019-05-11 17:21:21 +08:00
Sweet
4c690fb5a3
Null point Exception during loading the checksum ( #1788 )
...
If you connect to the mysql with version 5.1, the result of command 'select @master_binlog_checksum' is an array with only one Null element .
2019-05-11 17:17:54 +08:00
Jet
8f088cddc0
Fix es bulk ( #1743 )
...
thanks
2019-04-25 09:36:09 +08:00
Jet
e94ee64316
fix typo in trace log ( #1738 )
2019-04-24 09:57:05 +08:00
dataccs
3165cb9640
支持用户自定义的CanalAlarmHandler ( #1736 )
...
* 支持用户自定义的CanalAlarmHandler
* RowsLogEvent增加对TableMapLogEvent判空检查,防止NPE异常
2019-04-24 09:56:32 +08:00
rewerma
2b738f4e04
fix bugs ( #1712 )
...
* kafka 模式默认开启事务异步发送
* fix adapter etl rest sql inject bug
* fix #1704
2019-04-18 20:33:15 +08:00
rewerma
16f335c381
修复rest etl 存在SQL注入风险 ( #1685 )
...
* kafka 模式默认开启事务异步发送
* fix adapter etl rest sql inject bug
2019-04-15 23:58:12 +08:00
王超
a8bf2b641f
String.split(String regex) bug fix ( #1696 )
2019-04-15 23:55:03 +08:00
chenxyz707
67faf0e03e
resovle config/metrics as a destination folder ( #1678 )
2019-04-09 21:05:42 +08:00
Xin Wang
8cb85753bb
open the switch to get codecov test coverage ( #1671 )
...
* add codecov for test coverage
2019-04-09 19:11:48 +08:00
agapple
df86f94409
fixed issue template
2019-04-09 15:12:30 +08:00
agapple
80594444f7
fixed issue template
2019-04-09 15:11:14 +08:00
agapple
d8996432b9
add issue template
2019-04-09 15:08:43 +08:00
agapple
69df50fe17
fixed issue #1672 , CanalKafkaProducer send
2019-04-08 19:57:00 +08:00
agapple
c5736bd5f3
Merge pull request #1670 from lovepoem/update_compile_jdk
...
update jacoco lib
2019-04-08 12:28:27 +08:00
Xin Wang
55030476ee
reverse jdk to 1.8
2019-04-07 19:14:46 +08:00
Xin Wang
cd007088db
reverse jdk to 1.8
2019-04-07 18:52:35 +08:00
Xin Wang
1fc880f255
reverse jdk to 1.7
2019-04-07 18:45:54 +08:00
Xin Wang
8c68cf833a
update jacoco lib
2019-04-07 18:38:50 +08:00
Xin Wang
0de8f4691e
update jacoco lib
2019-04-07 18:25:05 +08:00
Xin Wang
5a2efbf9cb
update jacoco lib
2019-04-07 18:23:53 +08:00
agapple
dfab98fce1
Merge pull request #1669 from lovepoem/add_test_coverage_and_jdk11
...
add test coverage and jdk11
2019-04-06 23:37:40 +08:00
Xin Wang
e5c7bbffbf
update pom
2019-04-06 18:13:41 +08:00
Xin Wang
e139698f6e
update pom
2019-04-06 17:50:05 +08:00
Xin Wang
2b8120b6ed
update pom
2019-04-06 17:49:03 +08:00
Xin Wang
68ebb3a957
update skipTests=false
2019-04-06 17:35:16 +08:00
Xin Wang
21309cb065
resove Could not resolve dependencies for project com.alibaba.otter:client-adapter.hbase:jar:1.1.4-SNAPSHOT: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path
2019-04-06 17:23:48 +08:00
Xin Wang
386567a633
resove Could not resolve dependencies for project com.alibaba.otter:client-adapter.hbase:jar:1.1.4-SNAPSHOT: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path
2019-04-06 16:56:03 +08:00
Xin Wang
95c69bb854
add test coverage and jdk11
2019-04-06 16:45:04 +08:00
Xin Wang
6febcf1a0f
add test coverage and jdk11
2019-04-06 16:42:45 +08:00
agapple
fadfe1d6ca
[maven-release-plugin] prepare for next development iteration
2019-04-04 10:25:44 +08:00
agapple
a7b12c7098
[maven-release-plugin] prepare release canal-1.1.3
2019-04-04 10:25:29 +08:00
agapple
2c320e8618
Merge pull request #1661 from rewerma/master
...
flatMessage模式下默认canal.mq.lingerMs=100
2019-04-04 10:08:34 +08:00
machey
d76d25df6c
flatMessage模式下默认canal.mq.lingerMs=100
2019-04-04 00:14:27 +08:00
agapple
b95c0d03cf
fixed issue #1660 ,support mysql8.0 caching_sha2_password auth
2019-04-03 23:42:41 +08:00
agapple
08af40221f
Merge pull request #1658 from rewerma/master
...
adapter 日志打印修改
2019-04-03 12:12:56 +08:00
rewerma
d13c1eb17c
Merge branch 'master' into master
2019-04-03 11:34:10 +08:00
agapple
82ed9db8ae
fixed rocketmq partition out of range
2019-04-03 11:26:31 +08:00
agapple
d3195ac973
fixed issue #1626 , support alter table id first
2019-04-03 10:58:43 +08:00
agapple
15e29d276a
fixed default xml config
2019-03-28 22:05:56 +08:00
agapple
d715ff64b4
fixed packet write batch
2019-03-28 21:52:51 +08:00
agapple
f63ce4ffe6
fixed mysql auth
2019-03-28 20:45:16 +08:00
agapple
a7f9a779ad
fixed issue #1640 , support schema partition
2019-03-28 17:01:36 +08:00
agapple
39aeeb8c58
Merge pull request #1641 from wangsaner/master
...
修改canal.mq.partitionHash散列规则,使其支持同库下的不同表hash至相同分区
2019-03-28 16:58:31 +08:00
wangsaner
9826948ebb
修改canal.mq.partitionHash散列规则,
...
当指明pk级做分区(schema.table:pk1^pk2)时,由table.hashCode()^column.getValue().hashCode()改为database.hashCode()^column.getValue().hashCode(),从而支持同库下不同表hash至相同分区
2019-03-28 16:01:02 +08:00
wangsaner
d6ef66a281
Merge pull request #1 from alibaba/master
...
merge
2019-03-28 10:37:24 +08:00
agapple
97640b717b
fixed compiler
2019-03-28 10:23:33 +08:00
agapple
20e7becfe9
fixed format
2019-03-28 10:19:53 +08:00
agapple
99b34ff632
Merge pull request #1639 from wangsaner/master
...
fixed issue #1636
2019-03-28 10:17:42 +08:00
wangsaner
739963acd0
fixed issue #1636
...
非flat模式,当MQ主题为多分区时,数据拆分只取了for循环里面的最后一份数据,
导致消费端只能消费到一个分区的数据
2019-03-27 21:57:04 +08:00
agapple
0ec4699149
fixed format & support Mysql Auth Switch Protocol
2019-03-27 11:54:40 +08:00
mcy
c101ae2280
Merge branch 'master' of https://github.com/rewerma/canal
2019-03-26 11:39:41 +08:00
mcy
a137deeaff
使用统一log
2019-03-26 11:29:52 +08:00
rewerma
c5be5b7a8a
Merge pull request #40 from alibaba/master
...
merge
2019-03-26 00:43:11 +08:00
agapple
95bed6bcf6
fixed fastsql
2019-03-25 19:50:02 +08:00
agapple
661d119265
fixed issue #1625 , mq dymaic topic match
2019-03-25 17:54:35 +08:00
agapple
08167c95c7
Merge pull request #1622 from rewerma/master
...
fix bugs
2019-03-22 18:14:14 +08:00
mcy
37c5168a7d
code optimization
2019-03-22 14:49:50 +08:00
mcy
579fa72ae2
kafka consumer connector引入事务隔离级别 fix #1512
2019-03-22 13:44:02 +08:00
rewerma
844c019433
Merge pull request #39 from alibaba/master
...
merge
2019-03-22 09:10:43 +08:00
agapple
c94e3a0024
fixed default properties
2019-03-21 20:59:09 +08:00
agapple
f6ca489984
Merge pull request #1620 from rewerma/master
...
fix bugs
2019-03-21 20:51:10 +08:00
agapple
b2b69307f9
fixed rocketmq
2019-03-21 20:50:52 +08:00
agapple
531b535228
fixed bug
2019-03-21 20:26:00 +08:00
mcy
99cccd2113
fix #1608
2019-03-21 20:07:06 +08:00
rewerma
38d8c3d462
Merge branch 'master' into master
2019-03-21 19:42:07 +08:00
agapple
024ffc2aa2
fixed mq partition num priority
2019-03-21 19:39:21 +08:00
agapple
a81d2710ff
fixed MQ partition
2019-03-21 19:27:39 +08:00
mcy
4bad0e88f8
增加日志配置 fix #1570
2019-03-21 19:04:33 +08:00
mcy
0181dfaa42
sql解析对case when 的支持
...
fix #1598
2019-03-21 18:35:58 +08:00
rewerma
0411d99e7b
Merge pull request #37 from alibaba/master
...
merge
2019-03-21 18:07:41 +08:00
agapple
8fcdd7f798
Merge pull request #1619 from rewerma/master
...
fix #1608
2019-03-21 17:58:57 +08:00
mcy
b0f4e4ee78
fix #1608
2019-03-21 17:55:35 +08:00
agapple
d448455ebf
Merge pull request #1613 from KangZhiDong/master
...
set utf8mb4 to support emoji
2019-03-21 16:49:44 +08:00
agapple
e07fdb6426
Update README.md
2019-03-21 16:46:42 +08:00
agapple
38336b249e
fixed travis
2019-03-21 16:36:41 +08:00
agapple
e7b81cd83a
fixed mvn wrapper
2019-03-21 16:30:05 +08:00
agapple
2810e7e815
add mvnw
2019-03-21 16:20:13 +08:00
agapple
024986a195
fixed travlis.yml
2019-03-21 16:16:31 +08:00
kangzhidong
9b2ad0eafd
set utf8mb4 to support emoji
2019-03-20 16:29:53 +08:00
康智冬
03d46f150f
Merge pull request #2 from alibaba/master
...
update
2019-03-20 16:21:38 +08:00
agapple
b488ca02d8
fixed travlis
2019-03-20 13:55:29 +08:00
agapple
17a6ba9c9c
fixed travlis
2019-03-20 13:44:29 +08:00
agapple
3b618740d4
Merge pull request #1607 from rewerma/master
...
ES同步新增父子文档索引适配
2019-03-20 13:35:25 +08:00
mcy
06bfcda275
code optimization
2019-03-20 10:41:51 +08:00
mcy
5821c1f606
modify
2019-03-20 09:10:15 +08:00
mcy
a2360efff9
增加对sql字段 `` 的支持
...
fix #1559
2019-03-19 19:13:15 +08:00
mcy
51c469aa6f
es etl 主键类型bug fix #1559
2019-03-19 17:54:11 +08:00
mcy
6b3bf31404
adapter代码整理优化
2019-03-19 17:49:00 +08:00
mcy
941ed7f60d
Merge branch 'feature/es2'
2019-03-18 09:06:58 +08:00
rewerma
9db2bd291b
Merge pull request #36 from alibaba/master
...
merge
2019-03-18 09:05:47 +08:00
agapple
95b26c4d1d
fixed #1433 , optimzier code
2019-03-17 10:35:16 +08:00
agapple
b114e0cb15
Merge pull request #1581 from alexinea/master
...
CanalSharp has transferred to .NET Core Community
2019-03-17 10:30:03 +08:00
agapple
5c96bf282e
Merge pull request #1590 from rewerma/master
...
fix #1585
2019-03-17 10:29:12 +08:00
agapple
6d280d1048
Merge pull request #1597 from KangZhiDong/master
...
fix the error log does not contain table name
2019-03-17 10:28:47 +08:00
agapple
cf4db1625d
Merge pull request #1605 from lizhyocx/master
...
解决单核服务器无法订阅数据的bug
2019-03-17 10:27:50 +08:00
lizhyocx
df98fec945
解决单核服务器无法订阅数据的bug
...
解决单核服务器c中anal.instance.parser.parallel = true时无法订阅数据的bug
2019-03-15 17:11:14 +08:00
mcy
e03705e211
es父子文档索引ETL支持
2019-03-13 17:19:08 +08:00
mcy
4df60a0fb5
es增加父子文档索引同步适配
2019-03-13 16:57:23 +08:00
kangzhidong
078673c6a9
fix the error log does not contain table name
2019-03-13 16:55:38 +08:00
mcy
4bd91a1079
fix bug
2019-03-13 14:36:27 +08:00
mcy
05ad671cc1
es增加relations配置
...
配置monitor yml加载使用通用加载类
2019-03-13 14:34:31 +08:00
mcy
43045bc672
use system time zone for es datetime field formatter
2019-03-13 10:01:16 +08:00
mcy
971c9a88c2
modify
2019-03-12 17:07:33 +08:00
rewerma
7b6e482827
Merge pull request #35 from alibaba/master
...
merge
2019-03-12 16:58:05 +08:00
mcy
ad39559f8c
fix #1585
2019-03-12 16:56:59 +08:00
AlexLEWIS
2707c12570
CanalSharp has transferred to .NET Core Community
...
CanalSharp has transferred to .NET Core Community(NCC) and became a member project of NCC.
2019-03-11 14:47:14 +08:00
康智冬
7dab5ac6c2
Merge pull request #1 from alibaba/master
...
update
2019-03-08 10:05:20 +08:00
agapple
9d4b61f083
Merge pull request #1567 from dragontree101/miss_producergroup_properties
...
producerGroup配置没有读取
2019-03-06 11:07:15 +08:00
dragonlong1986
a34f9ae97b
Merge branch 'master' into miss_producergroup_properties
2019-03-05 17:44:35 +08:00
dragonlong1986
64ca62b986
update
2019-03-05 17:39:56 +08:00
agapple
14c1af4c80
Merge pull request #1542 from rewerma/master
...
fixed #1538
2019-03-04 14:13:14 +08:00
agapple
7436d9f06f
Merge pull request #1550 from lee123lee123/master
...
Issues #1460 修改tsdb中同步数据带表情字符错误问题
2019-03-04 14:12:33 +08:00
agapple
c4599df1c2
Merge pull request #1560 from dragontree101/doc_mistake_key
...
key改成大写,小写不会生效
2019-03-04 14:07:22 +08:00
dragonlong1986
7abf50f233
key改成大写,小写不会生效
2019-03-02 10:25:19 +08:00
machey
1781381187
modify
2019-03-01 00:19:47 +08:00
machey
5d4210bd22
modify
2019-02-28 23:31:07 +08:00
machey
9888fae559
负时区的bug
2019-02-28 23:22:02 +08:00
rewerma
81ab7e9783
Merge branch 'master' into master
2019-02-28 19:37:27 +08:00
mcy
b891afa50e
增加时区判断
2019-02-28 19:28:17 +08:00
lee123lee123
8187d7c5df
Issues #1460 修改utf8数据带表情字符错误
2019-02-28 19:04:14 +08:00
mcy
e7f069850f
fixed #1538
2019-02-28 17:29:06 +08:00
agapple
d377a92a5d
fixed issue #1548 , NPE
2019-02-28 10:52:28 +08:00
agapple
f664af1af4
fixed issue #1546 , support drop database
2019-02-28 10:47:42 +08:00
agapple
5e2eabb3c2
Merge pull request #1544 from finefuture/MQ-fix-pr
...
fix issue 1532
2019-02-28 10:32:41 +08:00
agapple
f2368e5469
Merge pull request #1540 from wurongjun/master
...
修复当适配器mapping文件修改时,无法生效的问题
2019-02-28 10:32:07 +08:00
TomlongTK
fd4c8db92b
fix issue 1532
...
因为binlog日志同表名大小写的原因导致kafka的日志恢复并resize,报错之后引起集群崩溃
现在修改为投递消息的topic不区分表名大小写
2019-02-26 14:23:29 +08:00
mcy
f21abc13af
fixed #1538
2019-02-26 10:23:38 +08:00
wurongjun@duiba.com.cn
ae474d67ad
修复当适配器mapping文件修改时,无法生效的问题
2019-02-25 17:53:30 +08:00
bigbro
0c4711ab62
Merge pull request #2 from alibaba/master
...
合并原项目最新代码
2019-02-25 17:51:19 +08:00
agapple
072420c32b
fixed
2019-02-25 15:18:04 +08:00
agapple
1473a4a6b5
Merge pull request #1523 from rewerma/master
...
es adapter新增upsert属性
2019-02-25 14:50:58 +08:00
agapple
0fff514876
Merge pull request #1533 from DaiZZZZZ/master
...
CanalParameter添加parallel参数,用来配置canalinstance
2019-02-25 14:45:54 +08:00
agapple
4017de5102
Merge pull request #1526 from jiuchengspotorg/master
...
adapter rdb无法同步ddl更新问题修正
2019-02-25 14:15:47 +08:00
mcy
fcc1fc78ae
fix #1521
2019-02-22 17:09:50 +08:00
mcy
17efc2ada0
es 批量提交修改
2019-02-22 16:56:58 +08:00
zhikuodai
a68bd28852
CanalParameter类添加parallel参数
2019-02-21 22:04:06 +08:00
daizzzzz
1de8b27da1
Merge pull request #3 from alibaba/master
...
merge
2019-02-21 17:25:55 +08:00
mcy
01dc8ce2b8
YmlConfigBinder代码整理
2019-02-20 15:00:48 +08:00
jiucheng
f7e490f7a0
1、adapter/rdb,从库表字段(varchar,char,text,longtext)非空约束时,无法同步问题修正
...
2、主库存在0000-00-00 00:00:00时间时,从库表字段是非空约束时,无法同步问题修正
2019-02-20 10:10:14 +08:00
jiucheng
8cadd585c6
adapter rdb无法同步ddl更新问题修正
...
adapter/support/MessageUtil.java
2019-02-20 09:49:15 +08:00
mcy
57c3226e56
Merge branch 'feature/es2'
2019-02-19 15:05:59 +08:00
rewerma
79a3961da1
Merge pull request #34 from alibaba/master
...
merge
2019-02-19 15:05:34 +08:00
agapple
62338a945e
Merge pull request #1496 from rewerma/master
...
远程配置代码整理
2019-02-18 21:08:02 +08:00
agapple
e07db7b178
Merge pull request #1507 from i404/master
...
修复 FlatMessage Hash 到不正确的分区的Bug。
2019-02-18 21:05:03 +08:00
mcy
05cc627b5d
fix rdb etl bug
2019-02-15 11:39:26 +08:00
i404
44beaf1916
修复当 canal.mq.flatMessage = true 时,MQMessageUtils::messagePartition 数据分区错误的 bug
2019-02-14 18:26:01 +08:00
mcy
476244b26d
modify
2019-02-14 15:41:27 +08:00
mcy
cfdf509f9a
增加对pk的支持
2019-02-14 15:29:27 +08:00
mcy
c14ed724ff
update中增加upsert判断
2019-02-13 15:59:46 +08:00
mcy
5a4cfeab46
Merge branch 'master' into feature/es2
...
# Conflicts:
# client-adapter/elasticsearch/src/main/java/com/alibaba/otter/canal/client/adapter/es/support/ESTemplate.java
2019-02-13 15:51:24 +08:00
mcy
947cf130ab
fixed #1504
2019-02-13 15:50:11 +08:00
mcy
0ef21e4155
代码整理
2019-02-13 15:47:48 +08:00
mcy
83b760494d
ES adapter代码重新整理
...
新增upsert属性
2019-02-13 15:19:09 +08:00
mcy
aba8df699c
Merge branch 'master' into feature/es2
...
# Conflicts:
# client-adapter/elasticsearch/src/main/java/com/alibaba/otter/canal/client/adapter/es/config/SchemaItem.java
2019-02-12 17:21:42 +08:00
rewer
0c5f5c128f
整理代码
2019-02-07 13:49:35 +08:00
mcy
ad62275cd7
增加kafka自定义properties
2019-02-05 19:20:36 +08:00
mcy
f6d03bcb37
fixed #1490
2019-02-05 17:48:08 +08:00
mcy
5284aa9793
fix bugs
2019-02-01 16:20:53 +08:00
mcy
10276e254a
mq模式下adapter配置增加groupId属性对应
2019-02-01 15:18:16 +08:00
mcy
597a08ac37
通过groupId过滤对应的adapter配置
2019-02-01 13:51:49 +08:00
mcy
8211ef35e6
修改yml配置读取绑定,遵循spring yml加载方式,支持environment级占位符替换
2019-02-01 10:11:52 +08:00
mcy
a20960834b
远程配置代码整理
2019-01-31 09:45:52 +08:00
rewerma
7b6b332463
Merge pull request #33 from alibaba/master
...
merge
2019-01-31 09:03:37 +08:00
agapple
43f869599d
Merge pull request #1484 from liulangwa/master
...
捕获"rs = query("select @@global.binlog_checksum")" 结果rs为null的异常
2019-01-30 11:45:33 +08:00
agapple
e3d05f6201
Merge pull request #1482 from wurongjun/master
...
修复从数据库加载配置写入文件时因目录不存在出现的问题
2019-01-30 11:43:47 +08:00
codebee
032301102c
捕获"rs = query("select @@global.binlog_checksum")" 结果rs为null的异常
2019-01-29 17:10:26 +08:00
wurongjun@duiba.com.cn
bb64d84298
修复从数据库加载配置写入文件时因目录不存在出现的问题
2019-01-29 16:10:26 +08:00
bigbro
ccd39e9d62
Merge pull request #1 from alibaba/master
...
update
2019-01-29 16:03:43 +08:00
agapple
32031da9db
Merge pull request #1475 from rewerma/master
...
整理远程配置, 统一扩展接口
2019-01-29 10:13:03 +08:00
mcy
9a2e890f57
整理adapter端远程配置, 统一扩展接口
2019-01-25 18:50:30 +08:00
mcy
8f76b33214
解析配置修改
2019-01-25 17:51:38 +08:00
mcy
a7467539c7
整理server端远程配置, 统一扩展接口
2019-01-25 17:50:50 +08:00
agapple
db5495d158
Merge pull request #1464 from KangZhiDong/master
...
修改注释
2019-01-25 10:41:40 +08:00
kangzhidong
b04d948064
修改注释
2019-01-23 11:58:07 +08:00
agapple
5f8eb4d261
Merge pull request #1456 from rewerma/master
...
新增kafka消息投递事务
2019-01-21 23:45:13 +08:00
mcy
197ca67c8b
测试调整
2019-01-21 09:56:35 +08:00
machey
851637611f
modify
2019-01-20 15:02:06 +08:00
machey
4ebf17f57b
代码调整
2019-01-20 14:30:20 +08:00
machey
2f214ce3a6
采用事务批量异步投递kafka flatMessage
...
fixed #1454
2019-01-20 14:20:06 +08:00
agapple
8d4fbb395b
fixed issue #1451 , fixed NPE
2019-01-18 11:00:02 +08:00
agapple
d935c39648
Merge pull request #1449 from wdlily/master
...
fixed a word
2019-01-18 10:24:01 +08:00
wdlily
6e0e3fbef1
fixed a word
...
change '租' to '组'
2019-01-17 15:52:24 +08:00
rewerma
cbe88af2e3
Merge pull request #1442 from rewerma/master
...
fixed #1430
2019-01-17 15:18:40 +08:00
mcy
ba9d9dea6d
fixed #1433
2019-01-17 11:27:12 +08:00
mcy
2d88d803ee
merge #1440 and fixed #1430
2019-01-17 10:52:27 +08:00
rewerma
ff1fef1eb6
Merge pull request #32 from alibaba/master
...
merge
2019-01-17 10:48:23 +08:00
rewerma
4beb1e6855
Merge branch 'master' into master
2019-01-17 10:48:14 +08:00
rewerma
d2bbe9b061
Merge pull request #1440 from wurongjun/master
...
fix #1430
2019-01-17 10:46:30 +08:00
rewerma
171bedf488
Merge pull request #31 from alibaba/master
...
merge
2019-01-17 10:43:49 +08:00
mcy
e387cfdee5
fixed #1430
2019-01-17 10:22:08 +08:00
wurongjun@duiba.com.cn
47d7914304
停机时清空zk客户端信息,修复重启时报出的zk连接已关闭的异常
2019-01-16 17:28:51 +08:00
agapple
e4177ab0ce
Merge pull request #1419 from rewerma/master
...
specified mq dynamic topic
2019-01-16 10:27:25 +08:00
mcy
739f3b4fa1
fixed #1433
2019-01-15 18:39:32 +08:00
mcy
60441d8b31
fixed #1396
2019-01-15 18:20:05 +08:00
mcy
ca41be8412
fixed #1420
2019-01-15 11:38:00 +08:00
mcy
18b304f99d
specified mq dynamic topic
2019-01-14 14:25:47 +08:00
agapple
7f9dce4b77
Merge pull request #1418 from rewerma/master
...
fixed #1416
2019-01-14 13:10:32 +08:00
mcy
f26adff7c7
fixed #1416
2019-01-14 11:16:33 +08:00
mcy
77646c0185
拼写错误
2019-01-14 10:58:33 +08:00
agapple
7e4912cd2e
Merge pull request #1413 from wingerx/master
...
获取TableMeta信息时,增加一次retry操作
2019-01-12 11:26:30 +08:00
agapple
70a4f0363d
Merge pull request #1412 from rewerma/master
...
fixed #1408 fixed # 1403
2019-01-12 11:26:11 +08:00
winger
725960d46e
获取TableMeta信息时,增加一次retry操作
2019-01-11 14:00:15 +08:00
mcy
b00d347eb0
rdb adapter 增加 truncate dml适配 fixed #1408
...
fixed #1403
2019-01-11 13:40:37 +08:00
rewerma
92666b41e8
Merge pull request #30 from alibaba/master
...
merge
2019-01-11 12:59:01 +08:00
agapple
f1753e79f9
Merge pull request #1407 from lileibuaa/master
...
fix filter transaction entry logic in EntryEventSink
2019-01-11 10:29:06 +08:00
lileibuaa
f1a998b2d5
fix filter transaction entry logic in EntryEventSink
2019-01-10 21:16:25 +08:00
agapple
03e6662ce5
fixed mq
2019-01-08 23:57:16 +08:00
agapple
b845a67666
Merge pull request #1391 from rewerma/master
...
fixed 1390
2019-01-08 23:42:57 +08:00
mcy
690222bde8
dynamic topic 正则注释
2019-01-08 11:28:29 +08:00
mcy
63ad80c8c4
fixed 1390
2019-01-08 10:39:32 +08:00
agapple
de501c85a1
fixed issue #1374 , support queryLogEvent partition
2019-01-07 13:39:04 +08:00
agapple
670b7830a5
Merge pull request #1383 from rewerma/master
...
增加adapter远程配置
2019-01-07 13:31:01 +08:00
agapple
fdf150bd24
fixed issue #1341
2019-01-07 13:28:48 +08:00
agapple
c66b6a0f0f
fixed charset
2019-01-07 12:59:33 +08:00
machey
a91aebafc2
modify
2019-01-06 21:08:17 +08:00
machey
35fcd56822
Merge branch 'feature/mgr'
...
# Conflicts:
# client-adapter/rdb/src/main/java/com/alibaba/otter/canal/client/adapter/rdb/monitor/RdbConfigMonitor.java
2019-01-05 01:53:42 +08:00
machey
a63e982115
添加注释
2019-01-05 01:51:43 +08:00
machey
4bdf3d766f
modify
2019-01-05 01:44:04 +08:00
machey
779ebad890
adapter 远程配置
...
修改rdb热加载配置的问题
2019-01-05 01:42:27 +08:00
agapple
b348260288
fixed issue #1363 , date format
2019-01-03 11:48:33 +08:00
agapple
3011c3292b
Merge pull request #1362 from rewerma/master
...
fixed #1359
2019-01-02 22:42:22 +08:00
mcy
94b8fdbbf4
动态topic的xml配置
2019-01-02 13:28:27 +08:00
mcy
1dd9934f9c
fixed #1359
2019-01-02 13:23:32 +08:00
mcy
3dec7c50ce
commit
2019-01-02 11:05:46 +08:00
machey
ecd9ababa1
modify
2019-01-01 17:55:23 +08:00
machey
b0eaa156cc
增加adapter远程配置
2019-01-01 17:33:01 +08:00
agapple
a70178afef
Merge pull request #1357 from rewerma/master
...
canal server配置统一数据库管理监控
2018-12-31 12:16:21 +08:00
machey
114c3bd020
modify
2018-12-30 17:16:47 +08:00
machey
f9e19d46c4
增加注释
2018-12-30 17:08:11 +08:00
machey
661752096c
增加注释
2018-12-30 17:04:15 +08:00
machey
100b43a5db
Merge branch 'feature/mgr'
2018-12-30 16:50:32 +08:00
rewerma
5e116de264
Merge pull request #29 from alibaba/master
...
merge
2018-12-30 16:50:05 +08:00
machey
a1091368fb
modify
2018-12-30 16:47:35 +08:00
machey
71b7c0b868
canal server增加数据库远程配置
2018-12-30 16:44:35 +08:00
mcy
7c79714528
增加远程db config配置
2018-12-29 20:21:03 +08:00
agapple
8d84521767
Merge pull request #1355 from rewerma/master
...
adapter 分组间线程统一抛异常
2018-12-28 23:06:08 +08:00
agapple
14ba358525
fixed dymaic topic
2018-12-28 18:35:50 +08:00
mcy
7ea1468a8d
adapter 分组间线程统一抛异常
2018-12-28 17:30:04 +08:00
agapple
f72ac9a3bb
fixed adapter throw exception
2018-12-28 16:55:44 +08:00
agapple
f100aeda39
Merge pull request #1345 from rewerma/master
...
fixed 1341
2018-12-28 15:22:20 +08:00
agapple
953a0d0583
Merge pull request #1349 from mujiansu/master
...
fix bat syntax error
2018-12-28 15:20:05 +08:00
agapple
2afe7debda
Merge pull request #1305 from wingerx/master
...
修复同时开启gtid与tsdb 时gtid 属性丢失的问题
2018-12-28 15:13:47 +08:00
agapple
d8737a5228
fixed issue #1343 , support charset 255
2018-12-28 13:46:50 +08:00
mcy
150a13824b
修改 kafka 异步发送 flat message
2018-12-27 17:52:33 +08:00
JasonMu
830e149d0e
fix bat syntax error
2018-12-27 16:41:15 +08:00
mcy
d9e259dde4
增加支持按库名、表名动态发送topic支持
2018-12-27 15:40:04 +08:00
mcy
9e6adff942
修复adapter无法回退的问题,fixed 1341
...
修复HBase断连的问题
2018-12-26 15:24:30 +08:00
winger
82a78546ab
Merge remote-tracking branch 'upstream/master'
2018-12-26 15:11:17 +08:00
winger
19c35c0b08
修复:当mysql 发生过purged gtid时,同时开启tsdb与gtid后,gtid属性丢失问题
2018-12-26 15:10:57 +08:00
agapple
ade2a54369
Merge pull request #1340 from rewerma/master
...
fixed #1338
2018-12-25 22:42:25 +08:00
machey
dffbc437a6
fixed #1338
2018-12-25 22:27:27 +08:00
mcy
b5697a366a
merge
2018-12-23 18:24:04 +08:00
rewerma
0469d28c05
Merge pull request #28 from alibaba/master
...
merge
2018-12-23 18:20:43 +08:00
rewerma
d5f44dd76f
Merge branch 'master' into master
2018-12-23 18:20:33 +08:00
mcy
354d64069f
adapter增加同步异常重试
2018-12-23 18:16:47 +08:00
winger
3465866278
修复开启gtid时,同时开启tsdb后gtid 属性丢失的问题
2018-12-21 15:18:07 +08:00
agapple
840148fbf6
Merge pull request #1326 from rewerma/master
...
类型转换问题 fixed #1313
2018-12-21 15:10:25 +08:00
mcy
34b5f9c927
modify
2018-12-20 19:53:30 +08:00
mcy
75ee65f9e8
类型转换问题 fixed #1313
2018-12-20 19:45:57 +08:00
agapple
035ef26542
fixed issue #1306 , support MySqlOrderingExpr
2018-12-19 11:43:49 +08:00
agapple
4ef45b9a1d
Merge pull request #1310 from panjianping/master
...
添加 KafkaOffsetCanalConnector 使用示例
2018-12-18 16:51:50 +08:00
panjianping
990fa9498a
添加 KafkaOffsetCanalConnector 使用示例
2018-12-18 16:46:19 +08:00
agapple
276a2b988a
Merge pull request #1308 from panjianping/master
...
添加带kafka消息offset的Connector
2018-12-18 16:15:01 +08:00
panjianping
ef72cddfe8
添加带kafka消息offset的Connector
2018-12-18 11:54:41 +08:00
winger
d8d3246e30
Merge remote-tracking branch 'upstream/master'
2018-12-17 16:15:18 +08:00
winger
bba800eb96
修复开启gtid时,同时开启tsdb后gtid 属性丢失的问题
2018-12-17 16:14:55 +08:00
agapple
ff71bf515a
Merge pull request #1300 from gsfeng179/master
...
Update README.md
2018-12-17 12:52:58 +08:00
agapple
6ef48591a1
Merge pull request #1299 from rewerma/master
...
FlatMessage没有默认构造方法json反序列化的问题
2018-12-17 12:52:37 +08:00
gsfeng
a7526dbf4a
Update README.md
...
FAQ link error
2018-12-17 10:18:06 +08:00
mcy
51d94efc9c
dml类整理
2018-12-17 10:13:04 +08:00
mcy
833cc55e26
FlatMessage没有默认构造方法json反序列化的问题
...
Dml类增加isDdl属性
2018-12-17 09:47:09 +08:00
agapple
689366248d
Merge pull request #1289 from rewerma/master
...
rdb adapter增加mysql镜像db(schema)同步
2018-12-14 18:34:52 +08:00
mcy
3acdffb297
mirror schema 完成测试
2018-12-14 14:58:15 +08:00
mcy
fbf249580f
mirror db
2018-12-14 11:30:41 +08:00
agapple
d2e3e19831
fixed issue #1282 , NPE
2018-12-13 12:52:59 +08:00
agapple
0523b68c26
fixed parse error
2018-12-12 10:48:22 +08:00
agapple
995a33a645
Merge pull request #1278 from WithLin/master
...
Update AddressUtils.java
2018-12-12 10:44:05 +08:00
mcy
5c4b1f6e63
modify
2018-12-12 10:11:06 +08:00
XiaoFu
ba5865683f
Update AddressUtils.java
2018-12-12 10:03:49 +08:00
mcy
89a4943349
Merge branch 'master' into feature/rdb
2018-12-12 09:05:59 +08:00
agapple
35e0e882c1
fixed hash mode
2018-12-11 20:41:21 +08:00
agapple
0197482618
fixed partitionHash format
2018-12-11 20:17:08 +08:00
agapple
72bad4d54c
Merge pull request #1272 from rewerma/master
...
去除的多余的依赖
2018-12-11 17:03:07 +08:00
mcy
48de904ee1
去掉 #1266 中增加的 protocol 的多余的依赖
2018-12-11 14:43:13 +08:00
rewerma
f6a931d8c6
Merge pull request #27 from alibaba/master
...
merge
2018-12-11 14:15:33 +08:00
agapple
277a273ebc
fixed pull #1266 , optimizer code
2018-12-11 13:40:32 +08:00
agapple
bd5110b951
Merge pull request #1266 from rewerma/master
...
增加mq 分区规则配置正则表达式
2018-12-11 12:09:36 +08:00
machey
aeecf87490
去掉对before的判断,分区发送的表pk不能修改
2018-12-11 00:09:12 +08:00
machey
eac3f5ce5f
修改convert时设置pk
2018-12-10 23:54:07 +08:00
mcy
706ee88914
pattern表达式调整
...
pk缓存
2018-12-10 21:28:09 +08:00
agapple
7c63e81e01
fixed issue #1256 , rds alibaba_rds_row_id
2018-12-10 14:42:28 +08:00
mcy
99a1123e01
整理代码
2018-12-10 09:52:48 +08:00
mcy
24d898d87a
rdb 全schema同步
2018-12-10 09:25:40 +08:00
machey
5650b56bed
打印错误日志
2018-12-10 01:10:04 +08:00
machey
547cbf82c8
对原生message发送mq的分区支持
2018-12-10 01:03:18 +08:00
machey
03ee9c7ecf
根据主键Hash增加正则表达式支持,pk通配符指定自动获取支持
2018-12-10 00:09:49 +08:00
rewerma
ac738dae05
Merge pull request #26 from alibaba/master
...
merge
2018-12-09 22:06:29 +08:00
agapple
dda8081984
Merge pull request #1263 from tankilo/master
...
Linux启动脚本格式是DOS,需要转换成Unix格式
2018-12-08 13:26:52 +08:00
tankilo
f0fc37c43b
switch file format from DOS to UNIX
2018-12-07 14:54:45 +08:00
tankilo
5a99de1fa9
switch file format from DOS to UNIX
2018-12-07 14:54:06 +08:00
agapple
ce956c980d
add github template
2018-12-06 18:48:17 +08:00
agapple
c045dc244e
optimizer filter
2018-12-06 10:50:12 +08:00
agapple
1b11aa1d21
fixed issue #1220 , 解决一下no alive canal server重试过于频繁
2018-12-06 10:31:13 +08:00
rewerma
dac642f744
Merge pull request #25 from alibaba/master
...
merge
2018-12-03 17:55:32 +08:00
agapple
19e164b599
Merge pull request #1232 from rewerma/master
...
fixed #1229
2018-11-30 13:45:10 +08:00
mcy
339ecdd817
fixed #1229
2018-11-29 17:38:13 +08:00
rewerma
5fe7ae1613
Merge pull request #1228 from rewerma/master
...
rdb 关键字转译符过滤 fixed #1224
2018-11-29 15:42:19 +08:00
mcy
65f2695963
rdb 关键字转译符过滤
2018-11-29 15:39:08 +08:00
mcy
cf5e42442b
mysql jdbc依赖移到外部pom
2018-11-29 13:42:37 +08:00
agapple
e7b678d5e0
Merge pull request #1218 from rewerma/master
...
client打fat包排除其他包
2018-11-29 13:27:02 +08:00
mcy
f04447837c
client打fat包排除其他
2018-11-29 10:21:27 +08:00
rewerma
b7d2ad2e18
Merge pull request #1208 from rewerma/master
...
fixed #1201
2018-11-27 22:40:47 +08:00
machey
f1710f1c7f
fixed #1201
2018-11-27 22:39:49 +08:00
agapple
37094447b1
Merge pull request #1205 from rewerma/master
...
移除adapter pom中的parent fixed #1203
2018-11-27 19:41:42 +08:00
mcy
b97d377d83
移除adapter pom中的parent fixed #1203
2018-11-27 19:38:30 +08:00
agapple
46b6528273
fixed tablemeta check
2018-11-27 19:33:25 +08:00
agapple
6c3b3acde0
Merge pull request #1202 from DinoZhang/DinoZhang-patch-1
...
fix Datasource named ${DS_PROMETHEUS} was not found
2018-11-27 19:25:59 +08:00
DinoZhang
91b036a4fc
fix Datasource named ${DS_PROMETHEUS} was not found
2018-11-27 17:34:08 +08:00
DinoZhang
67cd0e5fca
Merge pull request #2 from alibaba/master
...
merge master
2018-11-27 17:10:57 +08:00
rewerma
9dfa5da7bc
Merge pull request #24 from alibaba/master
...
merge
2018-11-27 11:53:47 +08:00
agapple
9bda60bf89
fixed pom
2018-11-26 14:29:13 +08:00
agapple
9aaf20fb5e
[maven-release-plugin] prepare for next development iteration
2018-11-26 13:22:04 +08:00
agapple
8496ceaf15
[maven-release-plugin] prepare release canal-1.1.2
2018-11-26 13:21:51 +08:00
agapple
cf23e0ffea
fixed javadoc
2018-11-26 13:11:24 +08:00
agapple
4e9e3f5abe
fixed issue #1192 , NPE test
2018-11-25 21:17:34 +08:00
agapple
cbab3fb561
fixed issue #1168 , support filter with compareTableMetaDbAndMemory
2018-11-25 21:01:19 +08:00
agapple
f7bf4ac6ff
fixed log test
2018-11-25 18:33:34 +08:00
agapple
df4c66b9e2
Merge pull request #1193 from woshijay7788/feature_kafka_config
...
add max.request.size config
2018-11-25 11:55:51 +08:00
agapple
a6ee87281a
Merge pull request #1194 from guixincui/master
...
修改抽象引用
2018-11-25 11:55:00 +08:00
guixincui
90dab6831b
修改接口引用
2018-11-24 23:40:18 +08:00
gl
839d5415fc
add max.request.size config
2018-11-24 22:48:54 +08:00
agapple
29f03bf398
fixed batchSize calc
2018-11-24 15:34:39 +08:00
agapple
ec235f3efd
fixed rocketmq ak/sk
2018-11-23 09:56:55 +08:00
rewerma
3b25b3b342
Merge pull request #23 from alibaba/master
...
merge
2018-11-22 09:04:24 +08:00
agapple
aa89453bf6
fixed adapter
2018-11-21 22:49:22 +08:00
agapple
cc97f3b331
Merge pull request #1171 from rewerma/master
...
adapter 分批同步
2018-11-21 22:09:33 +08:00
agapple
89ec3037d4
Merge pull request #1173 from RickJou/master
...
等号两边都有空格
2018-11-21 21:48:15 +08:00
mcy
e711f1a091
rdb 并行提交
2018-11-21 16:57:02 +08:00
Alan
ad18e0335d
等号两边都有空格
...
格式保持一致,看起来更像大厂出品 ^_^
2018-11-21 16:31:46 +08:00
mcy
67cc73b8e2
adapter 配置修改
2018-11-21 14:26:19 +08:00
agapple
638952fad1
fixed binlog seek & aliyun ak/sk
2018-11-21 13:51:34 +08:00
mcy
56ec66f90e
adapter 分批同步
2018-11-21 13:46:30 +08:00
agapple
c0bbe530f1
Merge pull request #1169 from ymwneu/supportRocketMQ
...
[ISSUE#1109]Support aliyun RocketMQ
2018-11-21 12:51:31 +08:00
maowei.ymw
4bfc476e08
Modify rocketMQ related pom
2018-11-21 10:44:58 +08:00
rewerma
5d71d50d4e
Merge pull request #22 from alibaba/master
...
merge
2018-11-20 20:08:11 +08:00
agapple
26700f3005
fixed batch sync dml
2018-11-20 19:01:07 +08:00
agapple
a7be9c75f9
fixed mysql rotate checksum
2018-11-20 18:29:01 +08:00
agapple
b6f1e0d13c
fixed rocketmq ack npe
2018-11-20 17:14:29 +08:00
maowei.ymw
50630cc934
Support client connect rocketmq in aliyun
2018-11-19 14:33:59 +08:00
agapple
43db5bec97
Merge pull request #1155 from rewerma/master
...
es readme.md
2018-11-18 12:51:29 +08:00
mcy
affd598470
es readme.md
2018-11-17 21:18:48 +08:00
agapple
178bea07a8
Merge pull request #1154 from rewerma/master
...
adapter 配置修改动态加载
2018-11-17 15:29:00 +08:00
mcy
fcdf95b5ec
rdb 批量提交超时提交
2018-11-17 04:37:46 +08:00
mcy
991418ce6e
修改rdb批量提交分批的问题
2018-11-16 22:53:10 +08:00
mcy
d34bee3359
adapter 配置修改动态加载
2018-11-16 18:07:32 +08:00
agapple
0a3c1645e8
Merge pull request #1153 from rewerma/master
...
rdb 批量提交优化
2018-11-16 14:07:23 +08:00
mcy
9dc4d78b3b
fix
2018-11-16 13:24:36 +08:00
mcy
bc056288d4
rdb 批量提交优化
2018-11-16 13:12:50 +08:00
agapple
8aea31232b
Merge pull request #1151 from rewerma/master
...
将oracle mssql pgsql 的jdbc打包进lib
2018-11-16 10:16:26 +08:00
machey
fc6c871382
Merge branch 'master' into feature/mcy
...
# Conflicts:
# client-adapter/rdb/pom.xml
2018-11-16 00:06:56 +08:00
machey
14c0e4535a
将oracle mssql pgsql 的jdbc打包进lib
2018-11-15 23:59:16 +08:00
mcy
7ee7ba0e05
rdb 批量提交
2018-11-15 22:47:08 +08:00
agapple
7992b883d2
fixed binlog checksum
2018-11-15 19:40:23 +08:00
agapple
5bc0c3f06f
Merge pull request #1147 from rewerma/master
...
rdb 批量并行提交
2018-11-15 19:28:29 +08:00
mcy
b457ecd387
adapter 主配置application.yml动态加载
2018-11-15 17:09:53 +08:00
mcy
997646b2db
指定是否按主键hash并行同步, 否则按表名hash表间并行同步
2018-11-15 10:39:34 +08:00
mcy
915849b83a
预留sync(MappingConfig config, List<Dml> dmlList)方法
...
pk hash以old pk值为准若存在
2018-11-14 20:26:38 +08:00
agapple
129118b483
Merge pull request #1149 from spccold/master
...
filter views when dumpTableMeta
2018-11-14 19:50:41 +08:00
wuwo
aa68408c53
filter views when dumpTableMeta
2018-11-14 19:21:34 +08:00
mcy
d396a0b65c
rdb 批量提交
2018-11-14 18:21:50 +08:00
mcy
827b872cf8
rdb 批量并行提交
2018-11-14 18:05:55 +08:00
agapple
6f3cae5ddf
Merge pull request #1143 from rewerma/master
...
配置整理
2018-11-14 16:54:29 +08:00
mcy
31bf92ec8e
配置整理
2018-11-14 11:49:22 +08:00
mcy
68d8aee6c3
配置整理
2018-11-14 11:32:01 +08:00
mcy
c376f0afd2
配置中增加 canal.mq.acks canal.mq.compressionType
2018-11-14 11:14:32 +08:00
mcy
60e5554125
修改bootstrapServers为mqServers
2018-11-14 11:00:55 +08:00
mcy
241c43a894
Merge remote-tracking branch 'origin/master'
...
# Conflicts:
# client-adapter/common/src/main/java/com/alibaba/otter/canal/client/adapter/support/ExtensionLoader.java
2018-11-14 10:50:11 +08:00
rewerma
fecc112196
Merge pull request #21 from alibaba/master
...
merge
2018-11-14 10:48:04 +08:00
agapple
dd04577994
Merge pull request #1142 from spccold/master
...
let tsdbSnapshotInterval config work correctly
2018-11-13 22:04:16 +08:00
agapple
51a299259b
Merge pull request #1141 from Renkai/compression_type
...
Kafka增加参数acks和compressionType
2018-11-13 22:03:00 +08:00
wuwo
0a0a39880c
Merge remote-tracking branch 'upstream/master'
2018-11-13 20:54:45 +08:00
wuwo
5ad9cf3f16
let tsdbSnapshotInterval config work correctly
2018-11-13 20:54:36 +08:00
mcy
d29fe5b04e
去掉调试代码
2018-11-13 20:01:20 +08:00
agapple
20062d861d
fixed test code
2018-11-13 19:59:18 +08:00
agapple
73de8b32a9
Merge pull request #1140 from rewerma/master
...
adapter plugin
2018-11-13 19:51:36 +08:00
Renkai
8af1301062
Kafka增加参数acks和compressionType
2018-11-13 18:29:25 +08:00
mcy
8c3ade2d50
外部adapter plugin文件夹
2018-11-13 17:40:12 +08:00
rewerma
752a3cd66a
Merge pull request #20 from alibaba/master
...
merge
2018-11-13 14:13:41 +08:00
agapple
154ba422f2
fixed plugin
2018-11-13 14:10:48 +08:00
agapple
03a9522191
fixed event
2018-11-13 13:41:19 +08:00
agapple
c4947cad3c
Merge pull request #1133 from spccold/master
...
fix MemoryTableMeta#processTableElement bug
2018-11-13 11:34:15 +08:00
wuwo
3f8cdafea3
fix MemoryTableMeta#processTableElement bug
2018-11-13 11:14:37 +08:00
agapple
fcaf8e88f8
Merge pull request #1132 from rewerma/master
...
rdb adapter整理
2018-11-13 09:18:27 +08:00
mcy
e7ab25f819
增加rdb adapter说明
2018-11-12 18:26:34 +08:00
mcy
b45a27e231
db同步代码整理
2018-11-12 18:01:52 +08:00
mcy
2e5b7b89af
简化adapter配置
2018-11-12 17:30:40 +08:00
mcy
66912d3d05
rdb etl count destination 接口适配
...
es hbase 多源适配
2018-11-12 15:07:46 +08:00
agapple
ec1ac6d11c
Merge pull request #1131 from rewerma/master
...
rdb同步适配多数据源
2018-11-12 10:25:37 +08:00
machey
7cca8857ff
README.md 修改
2018-11-11 19:56:14 +08:00
machey
e7086415f8
rdb专用的的ClassExtensionLoader,默认canal client logger example配置
2018-11-11 19:44:30 +08:00
machey
4a27d81da1
Merge branch 'master' of https://github.com/rewerma/canal
2018-11-11 18:34:46 +08:00
rewerma
739425e99c
Merge pull request #19 from alibaba/master
...
merge
2018-11-11 18:33:46 +08:00
agapple
cc1574d913
fixed adapter
2018-11-11 01:15:02 +08:00
machey
d7ab6e2dc1
rdb同步适配多数据源
2018-11-10 23:55:09 +08:00
agapple
808bedf984
Merge pull request #1128 from spccold/master
...
fixed DatabaseTableMeta#compareTableMeta
2018-11-10 12:17:09 +08:00
agapple
357eb885b2
Merge pull request #1127 from rewerma/master
...
canal server端 MQ 配置修改
2018-11-10 12:16:31 +08:00
wuwo
417e04f655
fixed DatabaseTableMeta#compareTableMeta
2018-11-09 19:23:03 +08:00
mcy
2d41bb9960
修改mq配置针对destination级别重启
2018-11-09 18:19:51 +08:00
mcy
7d7c82ce91
修改mq配置针对destination级别重启
2018-11-09 18:12:04 +08:00
mcy
0c3f7a806e
代码整理
2018-11-09 17:06:42 +08:00
mcy
2a38bca34b
代码整理
2018-11-09 16:52:34 +08:00
mcy
c5bd42bbf1
canal server端 MQ 配置修改
...
MQ配置可动态加载
2018-11-09 16:39:52 +08:00
agapple
8c1f15a49e
Merge pull request #1126 from rewerma/master
...
关系型数据同步adapter, 支持 mysql oracle postgresql sqlserver
2018-11-09 15:26:07 +08:00
agapple
f9778a0aff
fixed issue #1087 , support kafka docker check
2018-11-09 13:58:39 +08:00
mcy
2ac84b4320
关系型数据同步adapter, 支持 mysql oracle postgresql sqlserver
2018-11-08 19:34:15 +08:00
jiangahng.loujh
0677443ccf
fixed issue #1100 , fix type compare
2018-11-08 13:57:12 +08:00
jiangahng.loujh
2c1f3e649a
fixed issue #1107 , more info message
2018-11-08 13:50:23 +08:00
agapple
4faf5428b1
Merge pull request #1120 from rewerma/master
...
flagMessage json 序列化无null值的bug
2018-11-08 13:39:09 +08:00
mcy
b71472661b
Merge branch 'master' into feature/mcy
2018-11-08 11:23:47 +08:00
mcy
6fa111866f
flagMessage json 序列化无null值的bug
2018-11-08 11:22:34 +08:00
mcy
f7ea8df89e
rdb新增同步测试完成
2018-11-08 11:19:50 +08:00
agapple
041225c3f2
Merge pull request #1118 from littleneko/patch-1
...
fix: buildLastTransactionPosition 的 for 循环少了 =0
2018-11-07 21:58:30 +08:00
agapple
a8d708ea1b
Merge pull request #1116 from spccold/master
...
a little improvement for DatabaseTableMeta
2018-11-07 21:55:54 +08:00
mcy
5ae7112192
init rdb sync
2018-11-07 21:01:50 +08:00
littleneko
2278340c7b
fix: buildLastTransactionPosition 的 for 循环少了 =0
2018-11-07 20:24:38 +08:00
wuwo
87abaee8a7
a little improvement for DatabaseTableMeta
2018-11-07 15:50:33 +08:00
agapple
8f2e2b9ccd
Merge pull request #1108 from spccold/master
...
skip tsdb snapshot apply if has not receive new ddl change from last …
2018-11-07 15:01:43 +08:00
agapple
d2ecb0aad9
Merge pull request #1112 from rewerma/master
...
client 排除jsr305不打进fat jar
2018-11-07 15:00:40 +08:00
mcy
1126d26574
Merge branch 'master' into feature/mcy
2018-11-07 11:40:06 +08:00
mcy
b71e299161
kafka单个partition的发送未改为同步发送的bug fix
2018-11-07 11:37:16 +08:00
mcy
572ea9f27a
Merge branch 'master' into feature/mcy
2018-11-07 09:34:00 +08:00
mcy
bc298bedd5
支持hbase rowkey指定数字长度
2018-11-07 09:32:52 +08:00
mcy
202557630c
调整etl锁的粒度
2018-11-07 09:05:47 +08:00
machey
c27d5fa162
ETL整个destination,同步开关无效的问题
2018-11-07 02:04:08 +08:00
machey
3090557eeb
client 排除jsr305不打进fat jar
2018-11-06 23:16:11 +08:00
machey
6de9f7efa7
修改 adapter release 打包名称
2018-11-06 22:49:34 +08:00
wuwo
f2b8d000f7
skip tsdb snapshot apply if has not receive new ddl change from last snapshot time
2018-11-06 16:59:44 +08:00
agapple
8ee546d34d
Merge pull request #1106 from rewerma/master
...
修改adapter打包,启动方式
2018-11-06 16:24:31 +08:00
mcy
5b94c69d10
修改adapter打包,启动方式
2018-11-06 14:52:17 +08:00
mcy
8ae192f0a9
adapter canal-client 版本
2018-11-06 09:56:16 +08:00
rewerma
2e1a1c31e6
Merge pull request #18 from alibaba/master
...
merge
2018-11-06 09:50:11 +08:00
agapple
238da873b2
Merge pull request #1104 from jiacheo/master
...
修复rocketmq&kafka 发送消息失败时回滚后继续提交的问题
2018-11-05 23:08:34 +08:00
jiacheo
edb5f294ef
fix:rollback之后继续commit,会产生 CanalServerException: ack error , clientId:1001 batchId:12 is not exist , please check 的错误。
2018-11-05 22:00:56 +08:00
agapple
5a76e2aa58
Merge pull request #1103 from wingerx/master
...
增加alter rename 的ddl 类型为rename
2018-11-05 19:50:20 +08:00
winger
1e20cac0da
Merge remote-tracking branch 'upstream/master'
2018-11-05 18:39:47 +08:00
winger
d8e411462e
增加alter rename 的类型为rename
2018-11-05 18:38:44 +08:00
agapple
59e65ed4a6
Merge pull request #1099 from spccold/master
...
destory TableMetaTSDB when stop EventParser
2018-11-05 17:39:50 +08:00
agapple
4319b5e888
Merge pull request #1098 from rewerma/master
...
ES Adapter 支持
2018-11-05 17:32:26 +08:00
mcy
0d9695c3a5
增加对array和object类型的支持
2018-11-05 17:29:11 +08:00
七锋
359aa1a074
fixed compiler failed
2018-11-05 16:53:15 +08:00
wuwo
e608f09b53
improve DatabaseTableMeta
2018-11-05 16:37:42 +08:00
wuwo
beed10901d
destory TableMetaTSDB when stop EventParser
2018-11-05 16:22:15 +08:00
mcy
dab6fa5aa1
Merge branch 'master' of https://github.com/rewerma/canal
2018-11-05 15:31:41 +08:00
rewerma
30d20f824b
Merge pull request #17 from alibaba/master
...
merge
2018-11-05 15:31:02 +08:00
mcy
80cf533b05
整理注释
2018-11-05 15:24:32 +08:00
七锋
6ff57f53f8
fixed issue #1070 , support mysql8.0.13
2018-11-05 15:06:40 +08:00
mcy
650446de5b
etl实现
2018-11-05 13:36:35 +08:00
mcy
347601b9fe
同步测试类
2018-11-05 11:40:27 +08:00
mcy
5c8a5998d9
修改外键
2018-11-05 10:06:45 +08:00
mcy
391e040c6a
删除测试完成
...
后续: 修改 删除外键的情况, 修改主键的情况适配
2018-11-02 17:19:52 +08:00
七锋
8597d9e926
fixed more info
2018-11-02 12:51:36 +08:00
agapple
a895ce666e
Merge pull request #1090 from jiacheo/master
...
CanalMessageDeserializer.deserializer 方法和FlatMessage.messageConverter 配合的问题
2018-11-02 11:10:22 +08:00
mcy
9d113dbc13
Merge branch 'master' into feature/mcy
...
# Conflicts:
# client-adapter/launcher/src/main/resources/application-sample.yml
# client-adapter/launcher/src/main/resources/application.yml
2018-11-02 11:08:57 +08:00
mcy
5cc2f8f9f7
增加file的path读取
2018-11-02 11:07:41 +08:00
mcy
5b9ada1f8c
修改测试完成
2018-11-02 09:51:30 +08:00
jiacheo
369059fa39
Merge pull request #1 from jiacheo/fix-lazyParseEntry-raw-wrong-value
...
Update CanalMessageDeserializer.java
2018-11-02 01:53:08 +08:00
jiacheo
9473f4e8fd
Update CanalMessageDeserializer.java
...
fix lazyParseEntry 'raw' wrong value.
2018-11-02 01:48:17 +08:00
rewerma
685053599f
Merge pull request #1086 from rewerma/master
...
release包不打进application.yml
2018-11-01 23:44:41 +08:00
machey
a9727cf267
release包不打进application.yml
2018-11-01 23:43:53 +08:00
agapple
bc399ba9f9
Merge pull request #1069 from spccold/master
...
pass useDruidDdlFilter parameter to LogEventConvert
2018-11-01 22:58:01 +08:00
mcy
81f403a9f2
更新完成
2018-11-01 21:07:45 +08:00
wuwo
332f759f96
filter dml before apply to tsdb
2018-11-01 17:38:18 +08:00
wuwo
5d5aafb7cd
Merge remote-tracking branch 'upstream/master'
2018-11-01 17:28:29 +08:00
mcy
f42f7cfe72
Merge branch 'master' into feature/mcy
...
# Conflicts:
# client-adapter/launcher/src/main/resources/application.yml
2018-11-01 16:39:56 +08:00
mcy
96b9484f70
modify
2018-11-01 16:37:47 +08:00
七锋
3bb408194d
fixed issue #1081 , support mariadb rotate_event support checksum
2018-11-01 16:03:40 +08:00
mcy
865ba94605
application.yml配置打包设置默认模板
2018-11-01 15:22:14 +08:00
mcy
bb883cd228
Merge branch 'master' into feature/mcy
2018-11-01 14:53:51 +08:00
rewerma
d3e1ddd234
Merge pull request #1084 from rewerma/master
...
fix #1083
2018-11-01 14:47:33 +08:00
mcy
b9c4884af1
fix #1083
2018-11-01 14:46:29 +08:00
mcy
a6b16eedfa
modify
2018-11-01 14:43:59 +08:00
mcy
9d04a82c42
新增完成
2018-11-01 14:32:11 +08:00
mcy
c9ad18894d
从表插入, 主表为简单字段
2018-11-01 11:33:12 +08:00
mcy
b2b44555ca
从表插入, 主表为简单字段
2018-11-01 11:07:35 +08:00
mcy
14e094b522
modify
2018-10-31 18:47:16 +08:00
agapple
0dea4b7944
Merge pull request #1079 from rewerma/master
...
application.yml不打包进jar
2018-10-31 17:34:33 +08:00
mcy
94a3cfa9de
Merge branch 'master' into feature/mcy
2018-10-31 17:18:57 +08:00
mcy
ed1feb9502
application.yml不打包进jar, 解决jar中的application.yml和config中的会合并bug
2018-10-31 16:58:50 +08:00
mcy
a4856b9a73
modify
2018-10-31 16:55:48 +08:00
七锋
ff3ccde62a
fixed rds binlog dump
2018-10-31 14:25:54 +08:00
mcy
2a2977eca7
主表带函数新增
2018-10-31 14:00:06 +08:00
七锋
1d9e2ccedd
fixed issue #1076 , support rds binlog expired
2018-10-31 12:51:02 +08:00
七锋
dd8243a56d
fixed issue #1075 , support message transactor filter
2018-10-30 23:48:05 +08:00
mcy
2c9acb655d
单表新增
2018-10-30 19:52:05 +08:00
mcy
e1191b665e
es配置加载
2018-10-30 15:57:00 +08:00
mcy
e4e23c9ecd
增加adapter相关参数: retry timeout batchSize
2018-10-30 14:13:51 +08:00
wuwo
4ce2b94241
rollback tsdb change
2018-10-30 11:49:49 +08:00
mcy
11ac253c46
adapter pom整理
2018-10-30 10:12:19 +08:00
mcy
1d2e85672c
elasticsearch适配器
2018-10-30 09:49:04 +08:00
mcy
82b8b56aa3
partition默认为空
2018-10-30 09:10:49 +08:00
mcy
4e18d7800a
拼写错误
2018-10-30 09:08:34 +08:00
rewerma
7efd067bd5
Merge pull request #16 from alibaba/master
...
merge
2018-10-29 20:14:36 +08:00
wuwo
4c7129115c
a little improve about tsdb
2018-10-29 17:49:34 +08:00
wuwo
0f14ed926b
pass useDruidDdlFilter parameter to LogEventConvert
2018-10-29 17:32:10 +08:00
七锋
be5f1546ca
fixed issue #1063 , rocketmq bugfix
2018-10-29 16:56:29 +08:00
agapple
f3160bf6cb
Merge pull request #1065 from f-zhao/zhaofeng-branch
...
fix: fix NPE, 使用CanalServerWithManager时,开启GTID模式下,不传入masterPosition的情…
2018-10-29 16:42:46 +08:00
赵峰
fa79db65b7
fix: fix NPE, 使用CanalServerWithManager时,开启GTID模式下,不传入masterPosition的情况下,会产生NPE
2018-10-29 16:18:12 +08:00
七锋
d134aa0c20
fixed adjust default value
2018-10-29 15:59:32 +08:00
七锋
b9f40f326f
[maven-release-plugin] prepare for next development iteration
2018-10-29 14:57:39 +08:00
七锋
774aeeea68
[maven-release-plugin] prepare release canal-1.1.1
2018-10-29 14:57:25 +08:00
七锋
f28efce11e
fixed javadoc for release
2018-10-29 14:54:17 +08:00
七锋
d03e7e2b15
fixed canal_version release
2018-10-29 13:49:24 +08:00
七锋
56ed158814
fixed issue #850 , support alter lock/algorithm
2018-10-29 12:46:20 +08:00
rewerma
166a9a7f8f
Merge pull request #1059 from rewerma/master
...
CanalConnector接口去掉stopRunning方法
2018-10-29 01:42:30 +08:00
mcy
b131e8cfa4
CanalConnector接口去掉stopRunning接口
2018-10-29 01:40:34 +08:00
mcy
2e1d0e36c5
group 线程池在父类初始化
2018-10-29 01:05:12 +08:00
agapple
ddcf619deb
Update README.md
2018-10-28 23:39:11 +08:00
rewerma
8f1b66ab5a
Merge pull request #1057 from rewerma/master
...
kafka canal-adapter 分布式开关的bug
2018-10-28 22:36:56 +08:00
mcy
167858cd95
解决分布式同步开关关闭同步状态下,
...
重启 kafka canal-adapter后在开启同步,丢失数据的bug
2018-10-28 22:35:32 +08:00
rewerma
04e56fb94c
Merge pull request #1056 from rewerma/master
...
group 线程池没有初始化的bug
2018-10-28 21:50:53 +08:00
mcy
00fce30072
group 线程池没有初始化的bug
2018-10-28 21:50:19 +08:00
rewerma
423392a18a
Merge pull request #1055 from rewerma/master
...
代码整理
2018-10-28 21:33:46 +08:00
mcy
cdb34571ab
adapter readme 修改
2018-10-28 21:31:57 +08:00
mcy
3b4d28eec3
测试修改
2018-10-28 21:30:54 +08:00
mcy
297122f47f
Merge branch 'master' of https://github.com/rewerma/canal
2018-10-28 21:19:53 +08:00
rewerma
f9ff05f16c
Merge pull request #15 from alibaba/master
...
merge
2018-10-28 21:17:04 +08:00
七锋
071545987b
fixed mq config
2018-10-28 21:15:57 +08:00
七锋
c36a51b8e3
fixed client-adpater logger test
2018-10-28 20:29:00 +08:00
七锋
232bbaf6d4
fixed group name
2018-10-28 19:58:07 +08:00
七锋
a0b38a9cac
fixed MQConnector
2018-10-28 19:52:26 +08:00
agapple
d76367584c
Merge pull request #1054 from duhengforever/canal_rocketmq_flatmessage
...
[ISSUE1027]Add flat message support to rocketmq
2018-10-28 17:37:38 +08:00
duhengforever
86fd77f9c4
Resolve conflict
2018-10-28 17:00:33 +08:00
duhengforever
ebaf78f5aa
Resolve conflict with master branch
2018-10-28 16:18:13 +08:00
duhengforever
b484593869
Add flat message support to rocketmq
2018-10-28 16:09:31 +08:00
mcy
a7bf6258f7
hbase类型转换工具类整理
2018-10-27 22:23:41 +08:00
rewerma
2c6bd3ee1b
Merge pull request #1050 from rewerma/master
...
修改hbase配置项名
2018-10-27 20:05:41 +08:00
mcy
87ac3daecc
修改hbase配置项名
2018-10-27 20:03:26 +08:00
七锋
fd7b9d766a
fixed snapshot expire
2018-10-27 00:47:50 +08:00
七锋
f822761ab2
fixed issue #1047 , support snapshot expire
2018-10-26 23:46:41 +08:00
七锋
1e2cf9d476
fixed bit(8) with value 255
2018-10-26 21:51:19 +08:00
七锋
2d930894ff
fixed issue #1046 , tinyint(1) unsigned with value 255
2018-10-26 21:50:12 +08:00
rewerma
30b7de7233
Merge pull request #1045 from rewerma/master
...
修改打包配置
2018-10-26 15:57:07 +08:00
mcy
0d22dbc982
修改打包配置
2018-10-26 15:56:05 +08:00
rewerma
8446e17703
Merge pull request #14 from alibaba/master
...
merge
2018-10-26 14:59:39 +08:00
七锋
fb936f896e
fixed client-launcher deploy
2018-10-26 14:57:52 +08:00
mcy
0d0fcbbc0b
修改HBase适配器配置
2018-10-26 14:03:29 +08:00
rewerma
5cfbc6b91d
Update README.md
2018-10-26 13:36:59 +08:00
rewerma
3b1f6ce4fb
Update README.md
2018-10-26 13:25:40 +08:00
rewerma
fd3927ce3e
Merge pull request #1042 from rewerma/master
...
canal adapter readme.md
2018-10-26 13:24:36 +08:00
mcy
bbfd4b4996
canal-adapter readme.md
2018-10-26 13:23:22 +08:00
mcy
848cbe11dd
代码整理
2018-10-26 10:33:16 +08:00
rewerma
f7185a618b
Merge pull request #1039 from rewerma/master
...
规范注释
2018-10-25 21:24:30 +08:00
mcy
d70dc8b88c
规范注释
2018-10-25 21:21:06 +08:00
agapple
b5f5d3f0f0
Merge pull request #1037 from rewerma/master
...
完善adapter-launcher及hbase-adaper相关功能
2018-10-25 20:19:48 +08:00
mcy
ddfc2464f3
etl 增加同步锁
2018-10-25 17:43:11 +08:00
mcy
c3402a97f3
etl 增加同步锁
2018-10-25 17:34:15 +08:00
mcy
6ee6b3c398
同步分布式开关
2018-10-25 16:43:33 +08:00
mcy
42a4abe4c7
HBase etl锁定同步等待
2018-10-25 14:24:33 +08:00
mcy
0f1334c92c
加入同步开关
2018-10-25 13:52:52 +08:00
七锋
346d091d00
fixed issue #1032 , support raw config
2018-10-25 13:11:34 +08:00
mcy
27dba9ec1b
HBase根据datasourceKey导入
2018-10-25 10:52:55 +08:00
mcy
8dbf63e436
增加adapter assembly打包
2018-10-25 10:05:05 +08:00
mcy
30a11c75cb
HBase的etl初步完成
2018-10-24 20:47:25 +08:00
mcy
49caff5759
HBase的etl初步完成
2018-10-24 19:12:16 +08:00
mcy
0a7251add0
HBase的etl初步完成
2018-10-24 18:30:42 +08:00
七锋
b5dac60cbb
fixed cliet-adapter artifactId
2018-10-24 17:00:56 +08:00
七锋
9270834631
fixed rds ak/sk config for manager
2018-10-24 16:46:26 +08:00
七锋
575dd59c78
fixed mysql set(8 bit) type parse
2018-10-24 16:25:28 +08:00
mcy
15e79c1400
调整Hbase适配
2018-10-24 15:40:48 +08:00
七锋
c75c248086
fixed issue #1019 , support canal embedded with Entry
2018-10-24 13:45:58 +08:00
rewerma
741f6310b3
Merge pull request #13 from alibaba/master
...
merge
2018-10-24 13:25:15 +08:00
rewerma
2202ec451a
Merge pull request #1028 from ttting/master
...
Fix Kafka FlatMessage Model Null Value set to ""
2018-10-24 12:58:00 +08:00
rewerma
1830458b6b
Merge pull request #1031 from rewerma/master
...
新增adapter-launcher工程
2018-10-24 12:56:55 +08:00
mcy
1b88430f71
去掉client-launcher, 移入client-adapter中重命名为example, 调整其他相关模块结构
2018-10-24 12:55:42 +08:00
mcy
bbb4c4347e
修改adapter-launcher模块名为launcher
2018-10-24 12:44:19 +08:00
mcy
0ee46ad70e
jar包依赖调整
2018-10-24 11:49:58 +08:00
mcy
243e129710
jar包依赖调整
2018-10-24 11:43:36 +08:00
mcy
a91f204682
新增adapter-launcher springboot工程
2018-10-24 11:29:28 +08:00
titeng.jiang
5bc5eec85e
Fix Kafka FlatMessage Model Null Value set to ""
2018-10-24 10:02:50 +08:00
agapple
80d3781d81
Update README.md
2018-10-23 23:27:42 +08:00
agapple
b1e2ab4448
Update README.md
2018-10-23 23:25:05 +08:00
rewerma
3e49e33f9f
Merge pull request #12 from alibaba/master
...
merge
2018-10-23 15:38:45 +08:00
agapple
986840b6bf
Merge pull request #1014 from wingerx/master
...
修复通过`show master status`获取到多个GTID 时,回车符导致UUID 解析失败的bug
2018-10-19 12:57:47 +08:00
winger
61aea888f6
Merge remote-tracking branch 'upstream/master'
2018-10-19 10:30:16 +08:00
winger
c16037122b
修复通过show master status获取到多个GTID 时,回车符导致UUID 解析失败的bug
2018-10-19 10:27:50 +08:00
七锋
a823b909ad
upgrade spring version 3.2.18
2018-10-17 18:35:32 +08:00
七锋
5d55c7ac00
fixed fastsql upgrade
2018-10-17 15:43:26 +08:00
rewerma
75f380252e
Merge pull request #11 from alibaba/master
...
merge
2018-10-17 00:48:03 +08:00
七锋
5eb67990ca
fixed es reset
2018-10-16 16:57:57 +08:00
七锋
017fe87e4b
fixed issue #928 , support Dml.executeTime
2018-10-16 16:55:30 +08:00
七锋
fc050c3ce9
fixed issue #980 , support TSDB dup column
2018-10-16 16:45:25 +08:00
七锋
b893aafae7
fixed issue #1001 , support docker restart
2018-10-16 13:33:45 +08:00
七锋
9c24b26d02
fixed gtid
2018-10-16 13:29:53 +08:00
agapple
22d1fc98ee
Merge pull request #1006 from WithLin/patch-2
...
support golang canal client address link
2018-10-16 13:12:43 +08:00
agapple
d88f204a15
Merge pull request #1002 from wallellen/fix-release-threadpool
...
1. AbstractEventParser 中应该对multiStageCoprocess每次在while最后进行stop而不是rese…
2018-10-16 11:36:28 +08:00
XiaoFu
5d0f79932a
Update README.md
2018-10-15 18:36:08 +08:00
wallellen
7c44e5933d
1. AbstractEventParser 中应该对multiStageCoprocess每次在while最后进行stop而不是reset, reset会在mysqlMultiStageCoprocessor中重新创建两个线程池, 如果在dump出错的情况下, 会无限多的创建multiStageCoprocess而且不释放
...
2. MySqlMultiStageComprocessor中需要判断是否已经shutdown, 实际情况中存在shutdown为true而terminal一直为false的情况
2018-10-12 18:27:32 +08:00
agapple
4d36c60738
Merge pull request #990 from shicmV5/master
...
增加 目标数据库密码加密解密,采用druid方式进行加密解密,并设置canal.instance.enableDruid=true时,请使…
2018-10-09 22:15:46 +08:00
shichengming
53c2a02124
增加 目标数据库密码加密解密,采用druid方式进行加密解密,并设置canal.instance.enableDruid=true时,请使用druid加密数据库密码。false时,就是使用明文密码。
2018-10-09 16:49:33 +08:00
agapple
1701a4c97c
Merge pull request #981 from rewerma/master
...
client模块中rocketmq-client包scope provide,外部使用单独依赖
2018-10-08 10:29:46 +08:00
mcy
e4b6385dcc
调整kafka同步发送和消费,确保消息不丢失
2018-10-03 16:32:08 +08:00
mcy
2e92ec3e4d
client模块中rocketmq-client包scope provide,外部使用单独依赖
2018-10-03 12:27:56 +08:00
rewerma
d20485027f
Merge pull request #10 from alibaba/master
...
merge
2018-10-03 12:09:49 +08:00
七锋
eb2a83b975
fixed test
2018-09-30 11:33:48 +08:00
七锋
9344ed121f
format & import
2018-09-30 10:52:41 +08:00
agapple
c3327e567e
Merge pull request #973 from duhengforever/develop_rocketmq
...
[ISSUE 800]提供RocketMQ原生接入canal
2018-09-30 10:28:37 +08:00
duhengforever
3ed8987779
Remove useless log print
2018-09-30 09:49:13 +08:00
duhengforever
fa8588f766
Modify canal-client config and polish consumer implementation
2018-09-30 09:40:05 +08:00
rewerma
fa8ffb8e66
Merge pull request #9 from alibaba/master
...
merge
2018-09-29 15:52:23 +08:00
agapple
9da8f9cc5a
Merge pull request #969 from WithLin/patch-1
...
Fix link error
2018-09-29 13:50:55 +08:00
duhengforever
af03f07cc7
Modify default config
2018-09-27 19:39:46 +08:00
duhengforever
5ae16b1c7c
Merge canal repo master
2018-09-27 17:09:00 +08:00
duhengforever
a37a7ff142
Add RocketMQ example and polish mq abstract class
2018-09-27 10:34:17 +08:00
agapple
ff592758cf
Merge pull request #970 from wingerx/master
...
fix bug #968
2018-09-26 13:13:27 +08:00
winger
b04446d24d
Merge remote-tracking branch 'upstream/master'
2018-09-25 18:46:39 +08:00
winger
40f8c931c7
fix bug #968 : 对于workpool与BatchEventProcessor需要手动调用halt(),否则会导致其使用的工作线程(池)无法正常关闭(parserExecutor/stageExecutor.shutdownNow()无效)
2018-09-25 18:46:10 +08:00
XiaoFu
a22517adc2
Fix link error
2018-09-25 17:53:54 +08:00
duhengforever
821f3eced5
Add mq adapter
...
Signed-off-by: duhengforever <duhengforever@gmail.com >
2018-09-25 10:22:31 +08:00
七锋
00ec70d425
fixed readme
2018-09-21 15:45:52 +08:00
七锋
9d48d23787
fixed readme
2018-09-21 15:44:03 +08:00
七锋
9535e82da6
fixed readme
2018-09-21 15:40:18 +08:00
agapple
fd80f953e9
Update README.md
2018-09-21 15:30:35 +08:00
agapple
05718a9f20
Merge pull request #958 from rewerma/master
...
kafka生产端增加按pk hash到对应partition功能
2018-09-21 15:10:01 +08:00
mcy
19b7f730b6
整理代码
2018-09-20 18:06:47 +08:00
mcy
4f2b4cea53
整理代码
2018-09-20 17:25:32 +08:00
mcy
e566160f1e
整理代码
2018-09-20 17:24:32 +08:00
mcy
74890050d0
kafka生产端增加按pk hash到对应partition功能
2018-09-20 16:48:14 +08:00
mcy
0cda90cdea
默认将数据发现kafka的partition 0,避免多分区的数据一致性问题
...
后续将支持通过id hash分发数据
2018-09-20 16:17:38 +08:00
rewerma
1a11153cd2
Merge pull request #8 from alibaba/master
...
merge
2018-09-20 16:03:43 +08:00
duhengforever
d5aa324ce4
Add RocketMQ canal connector
2018-09-20 15:48:52 +08:00
七锋
09df602f3b
support filterTransactionEntry
2018-09-20 11:30:10 +08:00
agapple
b026c44ea8
Merge pull request #953 from DaiZZZZZ/master
...
单词拼写修正
2018-09-20 10:15:23 +08:00
zhikuodai
19f765df77
单词拼写修正
2018-09-19 15:16:38 +08:00
rewerma
4e1675033a
Merge pull request #7 from alibaba/master
...
merge
2018-09-18 10:18:32 +08:00
rewerma
e9439125bd
Merge branch 'master' into master
2018-09-18 10:18:22 +08:00
agapple
a11f9e4b34
Merge pull request #949 from WithLin/master
...
Fix simpleCanalConnector bug
2018-09-18 10:06:44 +08:00
agapple
10b0ade627
Merge pull request #947 from lcybo/master
...
修复group模式报错
2018-09-17 19:51:12 +08:00
WithLin
1a8d6e65cf
FIx
2018-09-17 11:18:00 +08:00
WithLin
9748fceda8
fix proto3 bug
2018-09-17 11:11:30 +08:00
mcy
7005c11ac2
fix序列化的一些问题, kafka生产端统一使用异步
2018-09-17 11:10:50 +08:00
XiaoFu
88bf2ae64d
Merge pull request #3 from alibaba/master
...
merge local repo
2018-09-17 10:55:55 +08:00
Chuanyi Li
cae6df1457
Update grafana tmpl.
2018-09-15 13:28:27 +08:00
Chuanyi Li
6682c56b9f
Canal metrics group mode support.
2018-09-15 13:21:38 +08:00
agapple
5394613ba6
Merge pull request #942 from wingerx/master
...
增加当前的gtid相关信息至Entry Header
2018-09-14 16:53:41 +08:00
winger
6e84b98651
example 增加获取当前gtid相关信息示例
2018-09-14 14:22:55 +08:00
winger
af1a6a851f
Merge remote-tracking branch 'upstream/master'
2018-09-14 14:07:02 +08:00
winger
1516cf779d
将当前的gtid,sequence no 和last committed信息增加至Entry(trx begin/end, rowdata) Header 中,客户端可从property中获取相关值
2018-09-14 14:06:32 +08:00
mcy
db56effd91
整理代码
2018-09-14 11:45:52 +08:00
mcy
f3d1c8b754
Merge branch 'master' of https://github.com/rewerma/canal
2018-09-14 11:24:27 +08:00
rewerma
abf6a37f3a
Merge pull request #6 from alibaba/master
...
merge alibaba/canal
2018-09-14 11:24:09 +08:00
mcy
e8e0032404
增加扁平Message用于卡夫卡数据投递
2018-09-14 11:22:47 +08:00
agapple
52734eac7e
Merge pull request #938 from WithLin/master
...
Fix upgrade proto2 to proto3
2018-09-13 18:53:10 +08:00
WithLin
ca61be5f5a
fix upgrade proto2 to proto3
2018-09-13 18:37:26 +08:00
XiaoFu
b28e3d6f18
Merge pull request #2 from alibaba/master
...
pull request
2018-09-13 15:28:54 +08:00
agapple
1ab1f119b8
Merge pull request #931 from rewerma/master
...
fix #904 : 空记录时sleep 1s防止循环get数据过快
2018-09-12 13:22:19 +08:00
agapple
a332f23b11
Merge pull request #919 from WithLin/master
...
Fix upgrade protobuf version
2018-09-12 13:20:40 +08:00
mcy
a6798c61df
空数据sleep 100ms
2018-09-12 09:03:43 +08:00
machey
8ae8f526a6
fix #904 : 空记录时sleep 1s防止循环get数据过快
2018-09-11 22:47:53 +08:00
XiaoFu
847634a0f2
Merge pull request #1 from alibaba/master
...
pull a request
2018-09-11 17:13:48 +08:00
agapple
bc8f201b21
Merge pull request #927 from rewerma/master
...
fix #912 解决guava冲突问题
2018-09-11 12:31:24 +08:00
mcy
e450c3f83f
fix #912 通过maven插件将guava修改包路径打包进canal.client
2018-09-11 11:35:47 +08:00
rewerma
32910b5983
Merge pull request #5 from alibaba/master
...
merge from alibaba/canal
2018-09-11 02:19:20 +08:00
WithLin
a497962153
Fix upgrade protobuf version
2018-09-07 14:27:19 +08:00
七锋
82f8a9fc98
fixed issue #483 , show slave hosts
2018-09-04 12:55:16 +08:00
七锋
f5bf1667a9
fixed mq and client launcher
2018-09-04 12:35:20 +08:00
七锋
a9cccb3017
fixed format
2018-09-04 11:39:23 +08:00
七锋
47ac10ca18
fixed issue #868 , NPE fixed
2018-09-04 11:28:56 +08:00
agapple
d4a70d5eea
Merge pull request #900 from rewerma/master
...
kafka server端代码调整
2018-09-04 10:55:04 +08:00
agapple
e78de8568e
Merge pull request #902 from wingerx/master
...
fix bug #890 : 并行解析 + Gtid .没有初始化LogContext中的gtidSet
2018-09-04 10:53:07 +08:00
mcy
728550cac3
增加kafka producer send结果同步判断
2018-09-04 09:56:51 +08:00
mcy
81c216f1c1
增加kafka get的超时时间
2018-09-04 09:39:02 +08:00
mcy
17f345bfe5
0.11的环境未测过,先去除kafka的事务
2018-09-03 18:07:43 +08:00
mcy
ebf9139762
增加kafka producer sender的callback,canal和kafka同步提交回滚
...
去除一个canal实例对应多个kafka topic的机制,一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M,最大为900K
2018-09-03 17:40:30 +08:00
winger
7de40091a3
fix bug #890
2018-09-03 15:28:15 +08:00
machey
ee5775ce05
去掉kafka server端TRANSACTIONBEGIN和TRANSACTIONEND的判断
2018-09-02 20:21:07 +08:00
agapple
21ef2e5dd4
Merge pull request #896 from lcybo/master
...
修复execTime快于canal当前时间,delay无data points
2018-08-31 13:59:57 +08:00
agapple
283956ee93
Merge pull request #894 from zhangxin1988/master
...
fix #893 index name contains "on" keyword
2018-08-31 13:59:29 +08:00
Chuanyi Li
06275a46ed
Fix no data points while execTime exceeding current time of canal server.
2018-08-29 19:52:09 +08:00
张鑫
ea81b1dc92
fix #893 index name contains "on" keyword
2018-08-29 14:37:27 +08:00
agapple
fd5cfe23db
Merge pull request #892 from rewerma/master
...
kafka client keep alive间隔时间
2018-08-28 17:47:31 +08:00
mcy
bcf30a9a05
去掉kafka canalBatchSize使用默认50
2018-08-28 15:52:36 +08:00
mcy
d5122dcf50
Merge branch 'master' of https://github.com/alibaba/canal
2018-08-28 15:49:27 +08:00
mcy
b5e05c8c77
kafka client keep alive间隔时间
2018-08-28 13:51:23 +08:00
agapple
9434ed513e
Merge pull request #881 from wingerx/master
...
fix bug: 并行解析模式下,开启gtid 会导致解析错误
2018-08-26 22:00:59 +08:00
winger
6fe3ef43d8
fix bug: 并行解析模式下,开启gtid 会导致解析错误
2018-08-25 09:17:13 +08:00
winger
c1f92858a2
fix bug: 并行解析模式下,开启gtid 会导致解析错误
2018-08-25 03:54:38 +08:00
agapple
00b5ade787
Merge pull request #876 from rewerma/master
...
整合 kafka 到 server 和 client
2018-08-24 12:05:07 +08:00
mcy
6b94f396ff
移除kafka client基于zk的HA机制
2018-08-24 10:52:04 +08:00
mcy
b7de1e5070
删除kafka kafka-client模块
2018-08-24 09:14:52 +08:00
machey
4fe6c36c49
Merge branch 'develop-tmp'
...
# Conflicts:
# kafka-client/pom.xml
# kafka/pom.xml
2018-08-23 23:59:20 +08:00
agapple
899592ce2a
Merge pull request #873 from lcybo/master
...
单核环境下创建线程池会出错。
2018-08-23 19:17:47 +08:00
Chuanyi Li L
8585761f42
Merge branch 'master' of https://github.com/lcybo/canal
2018-08-23 17:52:23 +08:00
Chuanyi Li L
1aa2e1a409
Ensure at least 1 thread for thread pool.
2018-08-23 17:51:25 +08:00
mcy
9e3d4a7ffe
HBase读配置空行的bug
2018-08-23 17:43:53 +08:00
mcy
fc3de4b7fd
整合canal.client和canal.kafka-client
2018-08-23 17:38:17 +08:00
mcy
e7f07d7d3e
整合canal.server和canal.kafka
2018-08-23 17:33:15 +08:00
七锋
6e07021223
fixed client version 1.1.1-SNAPSHOT
2018-08-23 14:27:16 +08:00
agapple
3c80b6c1f7
Merge pull request #865 from rewerma/master
...
fix #849 : HBase数据同步适配
2018-08-23 13:58:23 +08:00
mcy
20b0b39b14
fix #849 : hbase数据同步适配
2018-08-23 12:02:44 +08:00
lcybo
de59d22429
Merge pull request #861 from Lee-Think/master
...
Client QPS指标的datasource配置项由"Prometheus"改为取$datasource参数
2018-08-21 18:59:36 +08:00
lixiang
1bef1b72bc
Client QPS指标的datasource配置项由"Prometheus"改为取$datasource参数
2018-08-21 17:20:00 +08:00
mcy
47348e2e96
新增client-launcher模块,外部数据落地适配器的总入口
2018-08-20 18:22:11 +08:00
七锋
0f3c427e28
fixed docker run
2018-08-20 14:28:12 +08:00
七锋
9bde69b6d6
[maven-release-plugin] prepare for next development iteration
2018-08-20 13:29:12 +08:00
七锋
dd8b1ce955
[maven-release-plugin] prepare release canal-1.1.0
2018-08-20 13:28:57 +08:00
七锋
cb884094d5
fixed metrics
2018-08-20 13:01:22 +08:00
agapple
f567abdaee
Merge pull request #855 from lcybo/master
...
Remove TPS(events) in tmpl.
2018-08-20 10:16:03 +08:00
Chuanyi Li
02757693b4
Remove TPS(events) in tmpl.
2018-08-20 08:02:20 +08:00
agapple
35797ca6ff
Merge pull request #854 from lcybo/master
...
根据comments的改进
2018-08-19 20:48:23 +08:00
Chuanyi Li
5588da59b9
Update response time image.
2018-08-19 18:19:18 +08:00
Chuanyi Li
fbb3b814c0
Improve image.
2018-08-19 17:40:53 +08:00
Chuanyi Li
2784f33b52
Improve metrics.
2018-08-19 17:01:03 +08:00
Chuanyi Li
2656d1d2af
Improve overview image.
2018-08-18 17:32:03 +08:00
Chuanyi Li
b6359d014f
Add overview image.
2018-08-18 17:24:54 +08:00
agapple
a4445043c1
Merge pull request #853 from lcybo/master
...
修复启动时,没读到带execTime时,出现48年delay。
2018-08-18 13:59:54 +08:00
Chuanyi Li
59169876eb
Update images.
2018-08-18 12:21:24 +08:00
Chuanyi Li
d06ecdef20
Introduce grafana template, update images.
2018-08-18 12:20:11 +08:00
Chuanyi Li
4a10986b5f
Introduce grafana template, update images.
2018-08-18 11:15:53 +08:00
Chuanyi Li
e81b4279b8
Merge branch 'master' of https://github.com/alibaba/canal
2018-08-17 20:00:51 +08:00
Chuanyi Li
a6abe7fa82
Avoid 48 years delay at startup.
2018-08-17 19:55:08 +08:00
七锋
10a80b2752
fixed compiler
2018-08-17 19:55:08 +08:00
七锋
0131c3ad13
fixed merge code
2018-08-17 19:55:08 +08:00
mcy
62f975deeb
加上 if (logger.isDebugEnabled()) 防止message.toString每次都会被运行,message过大会卡cpu
2018-08-17 19:55:08 +08:00
winger
2accfbf5db
升级Kafka 版本至 2.11_1.1.1
2018-08-17 19:55:08 +08:00
yfpeng
7ed6fcdf04
debug memory leak
2018-08-17 19:55:08 +08:00
七锋
156fc0edbe
fixed docker build
2018-08-17 19:55:08 +08:00
七锋
c421ff718b
preapre for 1.1.0 release
2018-08-17 19:55:08 +08:00
七锋
cc31e2db7c
fixed docker build
2018-08-17 19:55:07 +08:00
七锋
10114f4a9f
fixed issue #727 , support rds binlog dump
2018-08-17 19:55:07 +08:00
七锋
e879216fa4
fixed compiler
2018-08-17 10:40:51 +08:00
agapple
f0ea893bf4
Merge pull request #845 from lcybo/master
...
Add header size for each packet.
2018-08-17 00:25:40 +08:00
Chuanyi Li
3053b9635a
Add header size for each packet.
2018-08-16 07:59:45 +08:00
七锋
a1588e5f98
fixed merge code
2018-08-15 19:45:11 +08:00
agapple
1fd623311e
Merge pull request #841 from lcybo/master
...
Create canal prometheus docs.
2018-08-15 17:25:43 +08:00
agapple
a480ef60ea
Merge pull request #844 from rewerma/master
...
加上 if (logger.isDebugEnabled()) 防止message.toString每次都会被运行,message过大会卡cpu
2018-08-15 17:23:27 +08:00
mcy
4776552605
加上 if (logger.isDebugEnabled()) 防止message.toString每次都会被运行,message过大会卡cpu
2018-08-15 14:26:55 +08:00
Chuanyi Li
efb7adc967
Create canal prometheus docs.
2018-08-14 22:24:50 +08:00
agapple
feb2af060f
Merge pull request #839 from payonxp/master
...
Debug Memory Leak
2018-08-14 16:39:41 +08:00
agapple
15526aab8c
Merge pull request #840 from wingerx/master
...
升级Kafka 版本至 2.11_1.1.1
2018-08-14 16:37:09 +08:00
winger
679fd464f4
升级Kafka 版本至 2.11_1.1.1
2018-08-14 16:09:44 +08:00
yfpeng
c8a32b578c
debug memory leak
2018-08-14 15:59:08 +08:00
Payon
84f3d92790
Merge pull request #1 from alibaba/master
...
merge
2018-08-14 14:04:47 +08:00
七锋
13291c8d7b
fixed docker build
2018-08-14 13:38:01 +08:00
七锋
8a74504fe3
preapre for 1.1.0 release
2018-08-14 13:29:03 +08:00
七锋
11d4761bcb
fixed docker build
2018-08-14 13:23:24 +08:00
agapple
72213bb80d
Merge pull request #833 from lcybo/master
...
store增加bufferSize,metrics server端口可配置
2018-08-13 22:42:01 +08:00
Chuanyi Li
e8aee3a276
Configurable metrics server port.
2018-08-13 21:50:50 +08:00
Chuanyi Li
a3bf1d59e6
Add size label for store metrics.
2018-08-13 21:03:30 +08:00
七锋
d3f52c6d3d
fixed issue #727 , support rds binlog dump
2018-08-13 10:16:28 +08:00
agapple
fb1126cf39
Merge pull request #828 from lcybo/master
...
canal 性能指标采集
2018-08-10 23:22:52 +08:00
Chuanyi Li
ec00792475
Enhance heartbeat, rowscount.
2018-08-09 23:54:53 +08:00
Chuanyi Li
d7bbb0d1a7
Reformat code.
2018-08-09 23:54:53 +08:00
Chuanyi Li
dfd58f4aa1
Improve sink blocking time resolution.
2018-08-09 23:54:53 +08:00
Chuanyi Li
179afb0340
Canal metrics snapshot version.
2018-08-09 23:54:52 +08:00
Chuanyi Li L
fec9803aae
Refactor metrics code.
2018-08-09 23:54:00 +08:00
Chuanyi Li
75de57c102
Prometheus refactor.
2018-08-09 23:51:26 +08:00
Chuanyi Li L
2084b1fc37
Add listener to write.
2018-08-09 23:51:25 +08:00
qmzhang
07d4d2023a
instance由manager管理时,CanalParameter#MetaMode增加本地文件方式,本地meta.dat存储位点信息;
2018-08-09 23:51:24 +08:00
七锋
fac278150e
fixed issue #801 , support canal docker
2018-08-09 23:48:06 +08:00
Chuanyi Li
da5fb30191
canal server metrics refactor.
2018-08-09 23:45:38 +08:00
Chuanyi Li L
01e74c73e2
Reformat code.
2018-08-09 23:43:26 +08:00
Chuanyi Li L
782ef7fe14
Netty server/client profiler skeleton.
2018-08-09 23:43:26 +08:00
Chuanyi Li L
bd14848600
Builder of Aggregator.
2018-08-09 23:42:27 +08:00
Chuanyi Li
1c245280c7
netty3 future listener for metrics.
2018-08-09 23:42:27 +08:00
七锋
d7f48f534b
fixed encoding example
2018-08-09 22:23:12 +08:00
七锋
8ce320148c
fixed code
2018-08-09 22:20:54 +08:00
七锋
3eef7b583d
Merge branch 'branch-rds-support' of github.com:alibaba/canal
2018-08-09 21:55:33 +08:00
agapple
89a32aaabd
Merge pull request #825 from lcybo/master
...
Remove dirty test case
2018-08-09 11:38:48 +08:00
charles.lin
b53131553e
Commit test case
2018-08-09 02:01:44 +08:00
charles.lin
68d8afae3e
Merge commit '9e816bc48f9955f9e2839873993cef9627c2f389' into branch-rds-support
...
Conflicts:
instance/manager/src/main/java/com/alibaba/otter/canal/instance/manager/CanalInstanceWithManager.java
instance/manager/src/main/java/com/alibaba/otter/canal/instance/manager/model/CanalParameter.java
parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/AbstractMysqlEventParser.java
parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/MysqlEventParser.java
2018-08-09 02:01:00 +08:00
Chuanyi Li
92f24bd02e
Remove dirty test case
2018-08-08 20:59:09 +08:00
charles.lin
61c7f7738d
rds binlog 下载支持
2018-08-08 19:29:52 +08:00
七锋
9e816bc48f
support otter use tableMetaTSDB
2018-08-08 18:54:57 +08:00
agapple
377a72e1c0
Merge pull request #814 from payonxp/pyf2
...
schema history storage interface
2018-08-08 10:36:41 +08:00
Payon
b1dc5bd59f
Merge branch 'master' into pyf2
2018-08-07 19:29:27 +08:00
七锋
23f7b3b5d8
fixed issue #818 , tableMeta tsdb bugfix
2018-08-07 18:51:23 +08:00
agapple
09339333bb
Merge pull request #816 from wingerx/master
...
fix ci: fixed compiler java 1.7
2018-08-07 18:23:41 +08:00
七锋
f36ce647e6
fixed issue #781 , upgrade fastsql 540
2018-08-07 17:46:36 +08:00
winger
6d3584b6fb
移除canal.instance.spring 依赖后,需要加入druid与mysql connector的依赖 2. PropertyPlaceholderConfigurer由canal.instance.spring移至db
2018-08-07 16:59:55 +08:00
七锋
4006cedaad
fixed issue #781 , 修复部分DDL解析异常
2018-08-07 16:44:40 +08:00
七锋
cd0bf60824
fixed compiler java 1.7
2018-08-07 16:19:58 +08:00
agapple
c4c45d9e0b
Merge pull request #813 from wingerx/master
...
fix #802 : 从otter中剥离MySQL 相关同步实现,作为example的参考
2018-08-07 15:50:09 +08:00
yfpeng
02868d8fec
为了解决回追数据时Rowdata与当前schema不匹配
...
对TableMeta提供持久化接口,可以根据timestamp匹配历史schema
2018-08-07 13:42:29 +08:00
winger
7d9e2dc69b
fix #802 : 从otter中剥离MySQL 相关同步实现,作为example的参考
2018-08-07 12:04:57 +08:00
agapple
7c7ce43455
Merge pull request #810 from wingerx/master
...
fix bug: kafka get row data for performance
2018-08-06 12:19:08 +08:00
winger
119c5a6971
Merge remote-tracking branch 'upstream/master'
2018-08-06 11:19:58 +08:00
winger
8a952d3a5f
fix bug: kafka get row data for performance
2018-08-06 11:11:57 +08:00
agapple
764e1b6dc0
Merge pull request #807 from qmz/master
...
instance with manager模式一些微调
2018-08-06 10:11:53 +08:00
qmzhang
4e5e2f84e0
Merge branch 'master' of https://github.com/alibaba/canal
2018-08-05 19:45:59 +08:00
qmzhang
3c716e2a43
instance由manager管理时,CanalParameter#MetaMode增加本地文件方式,本地meta.dat存储位点信息;
2018-08-05 19:40:14 +08:00
七锋
872dad8ce8
fixed issue #801 , optimizer docker
2018-08-04 10:37:55 +08:00
agapple
bd6ab1cc80
Merge pull request #806 from wingerx/master
...
支持GTID模式下,默认获取当前gtid值作为起始值
2018-08-03 19:48:42 +08:00
七锋
7fd958a490
fixed issue #801 , support canal docker
2018-08-03 17:48:32 +08:00
winger
da1ce51a0f
支持GTID模式下,通过获取当前gtid值
2018-08-03 11:11:38 +08:00
七锋
26edbeaa28
fixed kafka performance
2018-08-02 13:58:41 +08:00
七锋
93ebc7b973
fixed unused repo
2018-08-01 18:25:49 +08:00
agapple
50d1ec583b
Merge pull request #790 from wingerx/master
...
kafka producer 适配 row data for performance #726
2018-07-31 13:11:49 +08:00
winger
3d5f13fec8
kafka producer 适配 row data for performance #726
2018-07-31 10:34:19 +08:00
文哥
fe12a8481f
Merge pull request #788 from lcybo/master
2018-07-29 22:19:43 +08:00
Chuanyi Li
1eaf198acf
Revert test code.
2018-07-29 15:06:30 +08:00
Chuanyi Li
c0a40499b0
Canal monitoring(prometheus module) snapshot version.
2018-07-29 14:55:38 +08:00
七锋
8cfb70e080
fixed issue #782 , 重复了exception
2018-07-26 16:05:33 +08:00
agapple
d624358cb5
Merge pull request #782 from lcybo/master
...
MysqlMultiStageCoprocessor健壮性enhance
2018-07-26 15:51:39 +08:00
Chuanyi Li L
72b907a75f
Further improvement for issue #771 .
2018-07-26 15:22:38 +08:00
agapple
698573b14a
Merge pull request #780 from wingerx/master
...
fix bug #776
2018-07-26 15:13:25 +08:00
Chuanyi Li L
129051a56e
Further improvement for issue #771 .
2018-07-26 14:30:42 +08:00
winger
e608e1d601
fix bug #776
2018-07-26 12:33:10 +08:00
agapple
22a0d88fe9
Merge pull request #777 from wingerx/master
...
fix issue #771 #776 #756
2018-07-26 10:07:36 +08:00
winger
ccd1e52411
fix issue #771 #776 756
2018-07-25 16:38:38 +08:00
winger
aaf18ccd7e
fix issue #771 #756
2018-07-25 10:18:15 +08:00
agapple
62b1c1ea93
Merge pull request #768 from CAI1987/patch-4
...
修改Readme.md,新增数据订阅活动公告
2018-07-23 15:44:34 +08:00
CAI1987
20807e58c8
Update README.md
2018-07-23 15:39:23 +08:00
七锋
89eb3d6078
fixed test code
2018-07-20 16:45:09 +08:00
七锋
7b52568575
fixed unused code
2018-07-20 16:43:00 +08:00
七锋
d520260fe8
remove unused
2018-07-20 14:46:52 +08:00
七锋
77c1c65b83
fixed issue #726 , 提交测试用例
2018-07-20 14:32:51 +08:00
七锋
fe38bc16d2
fixed issue #726 , 优化完毕
2018-07-20 14:32:13 +08:00
agapple
b4c6490c94
Merge pull request #762 from CAI1987/patch-3
...
修改Readme.md 新增DTS说明
2018-07-19 20:24:44 +08:00
CAI1987
67f2e55d38
Update README.md
2018-07-19 20:14:49 +08:00
CAI1987
b9d7f0b6d0
Update README.md
2018-07-19 20:14:19 +08:00
CAI1987
b880d96a86
新增商业化版本说明
2018-07-19 20:13:01 +08:00
CAI1987
b9156936ae
新增商业版本说明
2018-07-19 20:12:03 +08:00
CAI1987
617f9bbc62
添加Canal商业化版本更新说明
2018-07-19 19:24:37 +08:00
七锋
b19eaeb89a
fixed issue #726 , 单链接复用ByteBuffer数组
2018-07-19 17:55:53 +08:00
七锋
5582a38930
fixed issue #726 , 优化SessionHandler里直接拼byte[],绕过protobuf的多次拷贝
2018-07-19 13:35:38 +08:00
agapple
c6eee47af6
Merge pull request #759 from wingerx/master
...
append gtid lastCommitted and sequenceNumber support
2018-07-18 19:26:51 +08:00
七锋
10bb800f85
fixed issue #726 , 优化SessionHandler的传输处理,提前序列化Entry
2018-07-18 18:21:45 +08:00
winger
89726a6365
append gtid lastCommitted and sequenceNumber support
2018-07-18 17:07:39 +08:00
七锋
8e856acac5
fixed issue #742 , improve h2 config
2018-07-17 22:32:57 +08:00
七锋
df8fe4a9eb
fixed issue #756 , improve exception logger
2018-07-17 22:15:42 +08:00
agapple
33a2a6121a
Merge pull request #754 from wingerx/master
...
fix issue #751
2018-07-17 21:04:18 +08:00
winger
441d2d2449
fix issue #751
2018-07-17 12:04:27 +08:00
七锋
bef6a66eaf
fixed issue #296 , support getWithoutAck/ack/rollback for NPE
2018-07-16 23:00:35 +08:00
七锋
c1805a4831
format DruidDdlParser
2018-07-16 22:54:35 +08:00
agapple
38eecd9aef
Merge pull request #747 from DinoZhang/master
...
add restart.sh
2018-07-16 22:52:46 +08:00
agapple
cef431c8af
Merge pull request #734 from qmz/master
...
add create database support
2018-07-16 22:52:04 +08:00
七锋
3efd589cb1
fixed issue #724 , retry for broke pipe
2018-07-16 22:45:16 +08:00
DinoZhang
92c570e967
Merge pull request #1 from DinoZhang/DinoZhang-patch-1
...
Create restart.sh
2018-07-12 15:53:49 +08:00
DinoZhang
cf7af17aec
Create restart.sh
2018-07-12 15:42:54 +08:00
agapple
3308bf0662
Merge pull request #737 from lcybo/master
...
Parallel参数细节的完善
2018-07-06 15:32:45 +08:00
Chuanyi Li
be605617c3
Parallel参数细节的完善
2018-07-05 20:24:42 +08:00
qmzhang
bb8fec963b
add create/drop databases event support
2018-07-05 16:57:36 +08:00
七锋
da8bf59d5b
fixed issue #726 , 多线程解析binlog DML事件,提升性能
2018-07-04 23:37:20 +08:00
qmzhang
54168af790
add create database support
2018-07-03 17:25:08 +08:00
七锋
f0bed4c762
fixed issue #726 优化时间类型的解析,速度从20MB提升到45MB
2018-07-03 14:52:48 +08:00
七锋
4d4d97419c
fixed issue #726 , 去掉socket receiveBuffer/sendBuffer的设置,影响网络吞吐量
2018-07-03 13:42:31 +08:00
七锋
41eef9a090
fixed issue #729 , isDdl bug
2018-07-02 14:34:46 +08:00
七锋
9ae6c0c863
fixed find event position
2018-06-27 18:33:48 +08:00
agapple
5f47809c8e
Merge pull request #709 from rewerma/master
...
增加canal-kafka-client的running状态监控
2018-06-21 14:25:22 +08:00
rewerma
f2e3ff2dae
增加canal-kafka-client的running状态监控
2018-06-21 11:30:11 +08:00
七锋
92778be5be
fixed fastsql version
2018-06-21 10:44:07 +08:00
agapple
5da8d391f8
Merge pull request #700 from rewerma/master
...
降低kafka依赖版本,申明server的running为volatile
2018-06-21 10:42:47 +08:00
mcy
f867b183ab
降低kafka依赖的版本为0.9.0.1
...
申明server的running为volatile
2018-06-18 12:15:28 +08:00
rewerma
ea555df315
Merge pull request #4 from alibaba/master
...
merge alibaba/canal
2018-06-15 15:59:37 +08:00
agapple
4af1e5fb84
Merge pull request #698 from nbqyqx/master
...
ClientRunningMonitor shutdown delayExector threadpool #697
2018-06-15 13:25:04 +08:00
machey
bf02db4cbc
fastsql 186 for build
2018-06-14 22:08:08 +08:00
Neal Hu
967f8d6b0f
Fixes #697 ClientRunningMonitor shutdown delayExector threadpool
2018-06-14 21:28:10 +08:00
Neal Hu
4f4b016da3
Merge pull request #2 from alibaba/master
...
merge master
2018-06-14 21:19:45 +08:00
七锋
a4255a6377
fixed format
2018-06-14 19:25:34 +08:00
agapple
dca1b20043
Merge pull request #695 from rewerma/master
...
增加kafka对canal binlog信息的生成消费支持
2018-06-14 17:55:31 +08:00
rewerma
025d36604b
Merge pull request #2 from alibaba/master
...
fixed client idleTimeout 1 hour
2018-06-13 18:31:04 +08:00
rewerma
e23a19cd85
整理代码
2018-06-13 18:29:15 +08:00
rewerma
593902d349
修改example的一些bug
2018-06-13 18:25:27 +08:00
rewerma
d014167226
kafka consumer 默认session timeout 修改
2018-06-13 17:57:49 +08:00
rewerma
df668a6f72
kafka 修改日志输出问题
2018-06-13 17:20:16 +08:00
rewerma
cc5eb1075b
kafka consumer example 修改
2018-06-13 15:51:28 +08:00
rewerma
19f4c5ae1b
kafka consumer 测试类修改
2018-06-13 15:40:49 +08:00
rewerma
4e41ebf746
kafka consumer close方式
2018-06-13 15:38:24 +08:00
rewerma
31cbdb1824
kafka consumer close方式
2018-06-13 15:36:21 +08:00
rewerma
1b6efdf463
修改kafka consumer关闭方式
2018-06-13 15:25:43 +08:00
rewerma
cb6c7ef3e8
完善注释
2018-06-13 14:24:32 +08:00
rewerma
4bd2a79905
kafka pom调整
2018-06-13 14:17:07 +08:00
rewerma
345e22bd2c
kafka 设置独立logback.xml
2018-06-13 14:16:37 +08:00
rewerma
9964bb75b1
kafka 客户端 example 完善
2018-06-13 14:01:30 +08:00
rewerma
ec072a45d8
kafka 客户端 example
2018-06-13 13:49:15 +08:00
rewerma
efb7b32694
kafka producer 修改配置,一个destination可以对应多个kafka topic
2018-06-13 13:36:28 +08:00
Neal Hu
74bc6368f2
stop running in example
2018-06-13 11:15:01 +08:00
rewerma
b96e4dd23a
kafka 客户端测试类
2018-06-13 11:13:35 +08:00
rewerma
d991e6be60
kafka 客户端消费代码整理
2018-06-13 10:34:28 +08:00
rewerma
e7846085fc
kafka 客户端消费完成基本测试
2018-06-12 19:25:03 +08:00
rewerma
6faa3fd586
增加对message的验证,过滤transaction begin end 类型
2018-06-12 13:28:49 +08:00
七锋
fa34eb0e59
fixed client idleTimeout 1 hour
2018-06-12 13:20:41 +08:00
rewerma
3e97e6b771
整理pom格式
2018-06-12 10:53:46 +08:00
rewerma
330da50a5e
修改kafka配置项属性
2018-06-12 10:23:50 +08:00
rewerma
e35a06743c
增加kafka的日志
2018-06-12 09:46:54 +08:00
rewerma
0d6757c257
增加kafka的日志
2018-06-12 09:46:01 +08:00
rewerma
e4cde2f6a1
修改withoutNetty的bug
2018-06-12 09:00:55 +08:00
machengyuan4081
9b7d62717e
kafka system.properties 的 bug
2018-06-11 23:31:02 +08:00
machengyuan4081
b306bde3ec
kafka producer
2018-06-11 23:19:28 +08:00
rewerma
31f72e1aac
增加 kafaka producer 直接从canal server消费数据发送
2018-06-11 19:52:55 +08:00
rewerma
ad201660a6
Merge pull request #1 from alibaba/master
...
pull
2018-06-11 17:21:09 +08:00
七锋
77f1dfd324
fixed heartbeat
2018-06-08 15:03:49 +08:00
七锋
11467fca2a
fixed issue #639 , support rename
2018-06-08 10:56:20 +08:00
agapple
cc8d5b4263
Merge pull request #682 from nbqyqx/master
...
Fix #631 Boolean java type support
2018-06-08 10:45:25 +08:00
Neal Hu
4022aa8b5a
stopRunning in example
2018-06-08 00:00:29 +08:00
Neal Hu
187b98fbda
Boolean Type support. https://github.com/alibaba/canal/issues/631
2018-06-07 23:52:13 +08:00
七锋
0f33c8c89c
fixed issue #677 , add gtidon default value
2018-06-07 14:03:33 +08:00
Neal Hu
b6967dc0dc
Merge pull request #1 from alibaba/master
...
pr
2018-06-07 12:37:14 +08:00
七锋
b734a32ae6
fixed issue #626 , support xa rollback/commit event
2018-06-06 11:39:59 +08:00
七锋
1f16310b7d
fixed issue #663 , ddl parse
2018-06-05 16:05:48 +08:00
七锋
5349a5c49b
fixed issue #657 , fixed ConcurrentModificationException
2018-06-05 16:04:07 +08:00
七锋
a2241e2521
fixed issue #641 , support uk parse
2018-06-05 15:41:03 +08:00
七锋
fedc07352b
fixed issue #662
2018-06-05 14:59:33 +08:00
七锋
e251de79f3
fixed issue #610 , utf8mb4 encode support
2018-05-10 19:53:52 +08:00
七锋
7076e3124d
fixed fastsql
2018-05-10 19:35:17 +08:00
agapple
fca7da6bba
Merge pull request #623 from rewerma/master
...
在CanalConnector接口加入stopRunning方法,用于优雅停止client
2018-05-10 19:34:24 +08:00
七锋
57c2cc4c4e
fixed issue #626 , support mysql xa parse
2018-05-07 21:25:29 +08:00
七锋
3c913d1e22
fixed issue #126 , support gtid
2018-05-07 18:33:37 +08:00
rewerma
4141049bb9
在CanalConnector接口加入stopRunning方法,用于优雅停止client
2018-05-07 15:13:24 +08:00
agapple
912a7a12be
Merge pull request #618 from hiwjd/feature/gtid-support
...
支持通过GTID同步binlog
2018-05-07 10:30:58 +08:00
agapple
5c2ed38d2f
Merge pull request #621 from spccold/master
...
close zkclientx if necessary when stop canal and fix CanalInstanceWithManager#doInitEventParser bug
2018-05-07 10:21:50 +08:00
七锋
c8f1d54fa1
fixed issue #619 , improve code
2018-05-07 10:18:25 +08:00
agapple
e0fa8e0f72
Merge pull request #622 from nbqyqx/master
...
block waiting interrupted by stop request
2018-05-07 10:12:50 +08:00
spccold
7eb6fb3e8a
fix CanalInstanceWithManager#doInitEventParser bug
2018-05-06 21:50:34 +08:00
Neal Hu
debfdb8873
abstract canal client test waiting until running == true
2018-05-05 23:55:57 +08:00
Neal Hu
eda7e4ca2b
block waiting interrupted by stop request
2018-05-05 23:06:16 +08:00
spccold
70e6bdde02
close zkclientx if necessary when stop canal
2018-05-05 11:35:41 +08:00
hiwjd
21f3f8c973
支持通过GTID同步binlog
2018-05-04 16:47:03 +08:00
七锋
f46133d116
upgrade fastsql 228
2018-04-18 13:30:31 +08:00
七锋
9b7de00efb
fixed performace
2018-04-12 20:10:48 +08:00
七锋
c340bd6565
upgrade fastsql 159
2018-03-16 15:10:02 +08:00
七锋
511734c3d8
fixed compiler error
2018-03-15 20:21:42 +08:00
七锋
af002f4e24
fixed bio socket
2018-03-15 20:20:29 +08:00
七锋
28ad12d0ea
upgrade fastsql 2.0.0_preview_151
2018-03-15 15:48:16 +08:00
agapple
6229a8593f
Merge pull request #555 from whaon/patch-1
...
renew an InetSocketAddress to resolve address again
2018-03-15 14:33:05 +08:00
whaon
256056e14f
renew an InetSocketAddress to resolve address again
...
resolve [issue427](https://github.com/alibaba/otter/issues/427 )
2018-03-14 09:55:20 +08:00
agapple
499be8bd8c
upgrade druid to fastsql
2018-03-13 16:28:08 +08:00
agapple
cd87ef00cc
fixed issue #553 , merge code
2018-03-13 10:00:11 +08:00
agapple
6b7109c66b
fixed issue #539 , support bio&netty
2018-03-12 23:21:43 +08:00
七锋
b90c9fac41
fixed druid version 1.1.9
2018-03-12 17:14:12 +08:00
agapple
88c79544f0
Merge pull request #532 from LavaCoref/hotfix/lava/1_json
...
fix(dbsync): json column of zero length has no value, value parsing s…
2018-03-12 16:37:50 +08:00
agapple
fddaff1bd9
Merge pull request #536 from Wu-Jianqiang/master
...
主要修复 SocketChannel 默认缓存大小(1MB)不够用时需自动扩充,否则将因缓存空间不足而造成I/O超时假象
2018-03-12 16:36:07 +08:00
七锋
847ebf9bf3
fixed issue #535 , use show create table to get tableMeta
2018-03-12 16:27:58 +08:00
Wu-Jianqiang
3e7e7b7f6e
修改:变量命名和super调用
2018-02-26 16:37:21 +08:00
Wu-Jianqiang
06e7f44114
修复:MASTER_HEARTBEAT_PERIOD 的计量单位是秒(可以包含3位小数表示毫秒),但不是纳秒。
2018-02-26 16:31:58 +08:00
Wu-Jianqiang
8ad603fea4
修复:SocketChannel 默认缓存大小(1MB)不够用时需自动扩充,否则将因缓存空间不足而造成I/O超时假象
2018-02-26 16:26:01 +08:00
WU Jianqiang
863a61d626
Merge pull request #2 from alibaba/master
...
merge
2018-02-23 23:17:46 +08:00
lvtianyu
7b38542183
fix(dbsync): json column of zero length has no value, value parsing should be skipped
2018-02-23 10:41:49 +08:00
agapple
0af789b1c7
Merge pull request #529 from yakirChen/master
...
TimelineTransactionBarrier import CanalSinkException; Maven Compile 的一些 Warning
2018-02-12 11:43:57 +08:00
agapple
2d49b709ca
fixed socket wait period 10ms
2018-02-12 11:43:03 +08:00
agapple
826a45c105
Merge pull request #528 from lcybo/timeout
...
Use mysql master heartbeat to detect phycial tcp connection failure.
2018-02-12 11:41:55 +08:00
yakirChen
03452dcdda
Merge branch 'master' of github.com:yakirChen/canal
2018-02-12 11:29:16 +08:00
yakirChen
514876f60f
[x] Fix Compile Error : TimelineTransactionBarrier.java:[70,27] 找不到符号: 类 CanalSinkException
...
[x] Fix Maven Wranning: The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[x] Fix MavenWranning : 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-jar-plugin is missing.
2018-02-12 11:28:42 +08:00
yakirChen
89994c52f9
[x] Fix Compile Error : TimelineTransactionBarrier.java:[70,27] 找不到符号: 类 CanalSinkException
...
[x] Fix Maven Wranning: The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[x] Fix MavenWranning : 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-jar-plugin is missing.
2018-02-12 11:17:54 +08:00
agapple
edc2fbe1dc
fixed issue #507
2018-02-12 11:15:43 +08:00
agapple
cfa90af33c
fixed unique and upgrade druid
2018-02-12 11:01:53 +08:00
Chuanyi Li
32d4174083
Merge branch 'timeout' of https://github.com/lcybo/canal into timeout
2018-02-11 00:16:07 +08:00
Chuanyi Li
bb0f3b3a7e
[MI] Use mysql master heartbeat to detect phycial tcp connection
...
failure.
2018-02-11 00:10:16 +08:00
Chuanyi Li
dc0010823f
[MI] Use mysql master heartbeat to detect phycial tcp connection
...
failure.
2018-02-10 23:42:06 +08:00
agapple
b1431f8827
Merge pull request #521 from lcybo/monitor
...
修改InstanceConfig未生成或已销毁时造成ServerRunningMonitor running状态与实际不一致的问题
2018-02-10 11:22:48 +08:00
agapple
b9e3629459
Merge pull request #522 from lulu2panpan/lulu2panpan-patch-1
...
修复死锁bug
2018-02-10 11:18:22 +08:00
agapple
31ed4efe3a
Merge pull request #497 from lcybo/master
...
通信模块log小优化
2018-02-10 11:15:44 +08:00
Chuanyi Li
6da1507405
Rollback running state and znode when start failed.
2018-02-06 20:54:33 +08:00
WU Jianqiang
0b82ee8d10
Merge pull request #1 from alibaba/master
...
pull & merge
2018-02-02 16:13:21 +08:00
Chuanyi Li
00890f87e5
Communication log optimization.
2018-01-18 21:11:46 +08:00
agapple
91ac0e30aa
fixed issue #483 , support show slave hosts
2018-01-10 14:35:26 +08:00
agapple
9316a3df6d
fixed issue #482 , retry for getTableMetaByDB
2018-01-10 13:49:25 +08:00
agapple
2d31e6bf91
Merge pull request #487 from jasonhx140/master
...
dump connection is disconnected
2018-01-10 13:41:30 +08:00
jason huang
a965d2cd04
dump connection is disconnected
...
dump connection is disconnected since SocketChannel.cache is overflow.
2018-01-09 18:25:51 +08:00
jason huang
93be9d1909
dump connection disconnected
...
dump connection will be disconnected since SocketChannel.cache is overflow.
2018-01-09 18:21:14 +08:00
jason huang
7cf9375ac6
Merge pull request #2 from alibaba/master
...
merge new release
2018-01-09 18:10:19 +08:00
agapple
af289cd9fb
fixed compiler error
2018-01-05 19:09:46 +08:00
agapple
d1f1c0716b
Merge pull request #473 from jasonhx140/master
...
connect mysql server failed when reconnect mysql server frequently
2018-01-05 18:55:18 +08:00
jason huang
0c7aed197a
cannot build mysql connection.
...
when invoke connect(), it will return a ChannelFuture instance, and then the "addListener" method is invoked by biz thread, however, "channelRead" method in BusinessHandler is executed by netty I/O thread.
ChannelFutureListener -> operationComplete() cannot guarantee that which is executed before than BusinessHandler -> channelRead() method.
reproduce it :
set below jvm parameter:
-Dio.netty.eventLoopThreads=1
It will caused new connection is timeout when AbstractEventParser -> start() -> parseThread ->erosaConnection.reconnect() is invoked.
2018-01-02 23:29:15 +08:00
jason huang
325d16bc66
Merge pull request #1 from alibaba/master
...
merge latest version
2018-01-02 23:03:52 +08:00
agapple
3104b4cc24
fixed issue #449 , optimize findTransactionBeginPosition
2017-12-27 17:34:46 +08:00
agapple
9595e6abbd
fixed semi sync format & refactor
2017-12-27 16:53:09 +08:00
agapple
c6f4de9f88
Merge pull request #455 from lucifax301/master
...
mysql semi support and mariadb gtid parse
2017-12-27 16:36:29 +08:00
lucifax301
d66839c965
mysql semi support and mariadb gtid parse
2017-12-18 14:10:53 +08:00
agapple
ac773009f8
Merge pull request #447 from zhmz1326/master
...
解决destination无限连接等待的bug
2017-12-13 10:31:48 +08:00
zhengmingzhi
8b03f172ed
解决destination无限连接等待的bug
2017-12-12 19:17:53 +08:00
agapple
5e206e4f7e
fixed issue #440 , optimize find position
2017-12-10 23:05:28 +08:00
agapple
448fc8bcde
fixed issue #440
2017-12-10 22:27:14 +08:00
agapple
c60b04424b
fixed issue #440 , optime find position
2017-12-10 22:24:24 +08:00
agapple
5aed505429
fixed issue #440 , enableTsdb
2017-12-08 23:21:40 +08:00
agapple
912f5db2c7
fixed issue #440 , for null position
2017-12-08 23:20:15 +08:00
agapple
8b57b9a0a5
fixed issue #442 , compareTableMetaDbAndMemory
2017-12-08 22:54:22 +08:00
agapple
d1c83ea7bb
fixed fastjson autotype
2017-12-05 19:46:49 +08:00
agapple
7d485efd71
Update README.md
2017-12-05 17:01:15 +08:00
agapple
20942533e6
[maven-release-plugin] prepare for next development iteration
2017-12-04 14:43:29 +08:00
agapple
6b2d80a145
[maven-release-plugin] prepare release canal-1.0.25
2017-12-04 14:43:16 +08:00
agapple
01ef15223c
fixed issue #415 , ignore flush privileges
2017-12-04 13:19:58 +08:00
agapple
da3290c381
Merge pull request #424 from lcybo/master
...
1.0.23里面修复的KILL DUMP exception问题在(#334 )里面被覆盖回去了
2017-12-03 21:36:33 -06:00
agapple
a9284b1b39
fixed compiler error
2017-12-04 11:35:02 +08:00
Chuanyi Li
3409472eb9
kill CONNECTION exception fix revert.
2017-11-23 22:25:47 +08:00
agapple
5348994b4a
fixed alisql heartbeat
2017-11-15 10:42:58 +08:00
agapple
a3b9f6f1eb
fixed NPE
2017-11-14 23:44:15 +08:00
agapple
2dc019709b
fixed quota ddl
2017-11-14 23:31:46 +08:00
agapple
c56f58deae
upgrade druid to 1.1.5
2017-11-01 20:29:47 +08:00
lulu2panpan
fa059804ce
修复死锁bug
...
当通过zk-cursor启动的时候,第一个Event类型是TransactionEnd,那么txState变为2的触发条件不仅仅有ddl和dcl,clear方法中isTransactionEnd的判断应该放到txState.intValue() == 2的后面,否则将导致死锁
2017-10-19 10:50:32 +08:00
agapple
8d6f19cc33
fixed default value
2017-10-15 16:19:02 +08:00
agapple
1463463f1e
fixed data
2017-10-15 16:08:29 +08:00
agapple
77342663e3
fixed rds binlog local
2017-10-15 15:55:30 +08:00
agapple
e01e48ff65
fixed h2 support
2017-10-14 01:14:13 +08:00
agapple
4f00f5ea8d
fixed tsdb test
2017-10-14 00:12:43 +08:00
agapple
19707f92d4
merge tsdb meta support and refactor
2017-09-30 23:21:17 +08:00
agapple
3930ea0f9b
Merge pull request #393 from KaimingWan/table_meta_support
...
Table meta support
2017-09-30 15:48:53 +08:00
wanshao
676cf47987
Merge branch 'master' into table_meta_support
...
# Conflicts:
# parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/dbsync/LogEventConvert.java
2017-09-30 15:47:02 +08:00
agapple
788c1d9b84
fixed issue #360 , socket pool bug
2017-09-23 11:50:25 +08:00
agapple
84a9aeb46c
Merge pull request #374 from alexandnpu/feature/avoid_use_multiline_exception_directly
...
try to avoid use multiline exception directly
2017-09-23 11:11:27 +08:00
kaimingwan
e8da1c884b
table meta support
2017-09-22 22:01:57 +08:00
alex.zheng
041cbf04c7
add uncaughtexception handler
2017-09-06 12:07:50 +08:00
alex.zheng
a1cf292baa
try to avoid use multiline exception directly
2017-08-29 16:05:12 +08:00
agapple
67436b2bc4
fixed issue #330 & #350 , json length & escapse
2017-08-03 21:15:09 +08:00
agapple
ca350a79bd
Merge pull request #343 from toruneko/bugfix-when-filterqueryddl
...
Bugfix when filterqueryddl
2017-08-02 00:20:25 +08:00
jianhao.dai
214e404e1b
挪到最前面
2017-07-20 11:37:24 +08:00
jianhao.dai
34bcfbc3cb
不管有没有filter,都应该对meta cache更新一下
2017-07-20 11:35:19 +08:00
HaiDai
402245dbbf
Merge pull request #2 from alibaba/master
...
merge master
2017-07-20 11:29:50 +08:00
agapple
2cebfa04dd
fixed test
2017-07-05 12:48:52 +08:00
agapple
62e8ff6ec8
fixed format
2017-07-05 12:46:32 +08:00
agapple
b265bf4669
Merge pull request #319 from day6/fixbug-clientTimeout
...
fixbug: soTimeout doesn't work.
2017-07-05 12:44:50 +08:00
agapple
989a69e7be
fixed format & import
2017-07-05 12:41:11 +08:00
agapple
780b4f715b
Merge pull request #333 from jasonhx140/master
...
fix bug:异常网络连接导致canal server 无法关闭
2017-07-05 12:38:33 +08:00
agapple
8e88dc87f7
fixed https://github.com/alibaba/canal/pull/334
2017-07-05 12:35:42 +08:00
agapple
867d6607d4
Merge pull request #334 from luoyaogui/master
...
针对使用netty取代JDK的socketchannel实现的优化
2017-07-04 21:50:07 +08:00
agapple
22e3d2f3f1
Merge branch 'master' into master
2017-07-04 21:49:22 +08:00
agapple
ecdd619da7
Merge pull request #331 from alexandnpu/feature/upgrade_zkclient
...
update zkclient to 0.10
2017-07-04 21:38:30 +08:00
luoyaogui
9ba93bae5f
Update DirectLogFetcher.java
2017-06-27 15:08:34 +08:00
luoyaogui
0b2f37a272
Update MysqlConnection.java
2017-06-27 15:07:52 +08:00
luoyaogui
0bd4a1146c
Update DirectLogFetcherTest.java
2017-06-27 15:07:07 +08:00
luoyaogui
3dba400624
Update MysqlUpdateExecutor.java
2017-06-27 15:05:33 +08:00
luoyaogui
523130cf8b
Update MysqlQueryExecutor.java
2017-06-27 15:05:00 +08:00
luoyaogui
525a00ea17
Update MysqlConnector.java
2017-06-27 15:04:39 +08:00
luoyaogui
b6090da0e5
Update PacketManager.java
2017-06-27 15:03:53 +08:00
luoyaogui
9ea88c7863
Update SocketChannelPool.java
2017-06-27 15:03:16 +08:00
luoyaogui
48c108806a
Update SocketChannel.java
2017-06-27 15:02:45 +08:00
Jason Huang
8600e9825b
fix bug:
...
现实运用中出现:client已经不存在但server端的连接仍然是存活状态。
在此种网络异常状态时,stop canal server会一直hang住。
原因:异常网络连接由于无数据传输,导致 io worker线程一直loop selector而无法退出。
解决方案:1. 设置keepalive 由os 监控。
2. 设置netty idle 机制,定时检测并主动close socket。(fix 时间单位bug)
3. 每次新创建socket channel时存储在一个容器内,在stop canal
server时,从容器内主动释放所有socket channel。
2017-06-26 19:24:15 +08:00
alex.zheng
29815c41b0
make zookeeperx work
2017-06-23 20:16:25 +08:00
alex.zheng
717e2cb7f3
update zkclient to 0.10
2017-06-23 14:48:28 +08:00
agapple
3e5b3e1467
fixed issue #321 , process TableIdNotFoundException
2017-06-22 13:37:11 +08:00
baiju
a46ac3b814
fixbug: soTimeout doesn't work.
2017-06-10 10:07:23 +08:00
agapple
f6c2eb8963
fixed issue #296 , NPE
2017-05-11 14:05:58 +08:00
agapple
07b979f242
Merge pull request #293 from MarkLinHz/master
...
fix bug of repeat log manager
2017-04-08 17:02:53 +08:00
yinxiu
6b20959a2d
fix bug of repeat log manager
2017-04-06 20:13:59 +08:00
agapple
fdd40224d5
fixed format & import
2017-04-01 22:20:00 +08:00
agapple
a6604978ed
Merge pull request #291 from MarkLinHz/master
...
重构LogPositionManager并适配XML配置
2017-04-01 22:06:54 +08:00
agapple
4d624cf184
[maven-release-plugin] prepare for next development iteration
2017-04-01 21:18:31 +08:00
agapple
7e026f2495
[maven-release-plugin] prepare release canal-1.0.24
2017-04-01 21:18:11 +08:00
agapple
2e3796cb07
fixed format
2017-04-01 21:04:21 +08:00
agapple
b2a5f482ee
fixed issue #284 , add slave_uuid
2017-04-01 21:01:07 +08:00
yinxiu
a78622ae02
rename log manager module and ajust xml
2017-03-28 20:33:14 +08:00
agapple
e5444ae658
Merge pull request #259 from GitHub-BruceTong/dev
...
fix bug for #202(canal.instance.filter.regex 修改后未生效)
2017-03-28 09:49:18 +08:00
agapple
73627df082
fixed issue #287 , support chinese & empty string valuewq
2017-03-28 00:25:11 +08:00
yinxiu
c0f2d274d7
refactoring log position manager module
2017-03-18 11:41:56 +08:00
agapple
2eb05b5934
fixed compiler error
2017-03-17 21:15:33 +08:00
agapple
83689ee519
fixed issue #274 , support mysql 5.7.17
2017-03-17 20:36:40 +08:00
agapple
d78b389737
revert pull request https://github.com/alibaba/canal/pull/256
2017-03-17 20:00:13 +08:00
agapple
20d8ac67dc
fixed issue #280 , refactor MysqlQueryExecutor use IOException
2017-03-17 19:40:12 +08:00
agapple
19a56fb77e
Merge pull request #282 from sun7059/patch-1
...
Update JsonUtils.java
2017-03-17 19:11:25 +08:00
agapple
c629e8c899
Merge pull request #283 from keyganker/master
...
upgrade fastjson for security
2017-03-17 19:10:58 +08:00
fengyong
75a5a4d7df
升级fastjson
2017-03-16 20:25:21 +08:00
孙鹏
045a2e5a50
Update JsonUtils.java
...
修复升级fastjson到1.2.28后JSONUtils报错的问题
2017-03-16 20:01:42 +08:00
agapple
11d0712291
Update README.md
2017-02-07 19:50:22 +08:00
GitHub-BruceTong
03ff9512dd
fix bug for #202(canal.instance.filter.regex 修改后未生效)
2017-01-22 15:52:04 +08:00
agapple
0ee2e767d2
fixed stop failed
2017-01-19 13:22:40 +08:00
agapple
ff97dcbbc9
format & import
2017-01-19 13:07:53 +08:00
agapple
92c1a51726
Merge pull request #256 from luoyaogui/master
...
使用netty重构socketChannel(jdk内置),修改了PacketManager实现,以及其他相关引用的类。
2017-01-19 12:47:23 +08:00
agapple
36216e63ea
Merge branch 'master' into master
2017-01-19 12:46:41 +08:00
agapple
db4fc68a55
fixed issue #257 , heartBeatTimerTask stop bugfix
2017-01-19 12:34:05 +08:00
agapple
eef58005d9
fixed format
2017-01-12 11:31:43 +08:00
agapple
8141ddc4e8
Merge pull request #250 from toruneko/fix-ha-switch
...
[BUGFIX] 在MySQL5.6做主备库切换时出现的filename乱码修复
2017-01-12 11:30:39 +08:00
agapple
004f26465f
Merge pull request #248 from z070204z/patch-1
...
修复mysql5.6以下报java.lang.NullPointerException
2017-01-12 11:29:52 +08:00
jianhao.dai
5dc62bbda8
seek method also need load checksum
2017-01-04 11:14:01 +08:00
z070204z
f45f1ac74f
Update MysqlConnection.java
...
修复mysql5.6以下报java.lang.NullPointerException
2017-01-03 18:03:42 +08:00
luoyaogui
5c11c71783
使用netty重构socketChannel(jdk内置),修改了PacketManager实现,以及其他相关引用的类。
2017-01-03 14:18:58 +08:00
agapple
f745c698e9
[maven-release-plugin] prepare for next development iteration
2016-12-30 14:57:19 +08:00
agapple
5f4bbab722
[maven-release-plugin] prepare release canal-1.0.23
2016-12-30 14:57:07 +08:00
agapple
a483f03711
fixed #227 , loadBinlogChecksum NPE
2016-12-30 14:51:22 +08:00
agapple
a1207060bf
format
2016-12-30 14:32:52 +08:00
agapple
5055fdb556
Merge pull request #245 from dangxia/master
...
issues#244
2016-12-30 14:30:00 +08:00
XuehuiHe
a69b69c724
issues#244
2016-12-30 11:39:02 +08:00
agapple
90e6d34fb4
Merge pull request #243 from deeplinux/master
...
原来的example内的startup.bat脚本直接运行时报语法错误
2016-12-29 13:45:32 +08:00
deeplinux
907ecd43e4
修改批处理中的!=为NEQ
2016-12-28 08:06:18 +08:00
deeplinux
c57a921a1a
修正批处理中的语法错误
2016-12-27 17:57:07 +08:00
agapple
83fee4ffbb
Merge pull request #231 from alexwangx/alexwang
...
fixed issue #227 , fixed Mysql5.1.73 throw NullPointerException
2016-12-02 18:06:36 +08:00
alexwang
bc7927fe75
fixed issue #227 , fixed Mysql5.1.73 throw NullPointerException
2016-12-01 17:39:51 +08:00
agapple
e67f27018c
fixed support json inteAddress
2016-11-28 14:11:12 +08:00
agapple
3f38ad6f49
fixed issue #227 , fixed binlog_checksum variables
2016-11-28 14:10:57 +08:00
agapple
96dca0b9e6
fixed issue #136 , support rds no primary key && mysql.ha_health_check
2016-11-17 17:52:52 +08:00
agapple
ad2a96b3f1
fixed json type cast exception
2016-11-10 11:12:35 +08:00
agapple
6284a429a0
fixed lazy
2016-10-11 21:37:39 +08:00
agapple
83d8a39d16
add ServerRunningMonitor.init
2016-10-11 19:39:55 +08:00
agapple
4898829384
Merge pull request #213 from lulu2panpan/master
...
修复issue #212
2016-10-11 19:25:06 +08:00
agapple
69a7e6d083
Merge pull request #208 from jianan789/master
...
mysql5.6.29'@@global.binlog_checksum'带单引号导致master退出,优化binlogFormat判断
2016-10-11 19:16:34 +08:00
agapple
a5d6c3b747
Merge pull request #210 from xujianhai/patch-1
...
不好的设计
2016-10-11 19:14:22 +08:00
agapple
86378cad32
Merge pull request #209 from lcybo/master
...
Fix a minor fault: Canal instance reload again after startup.
2016-10-11 19:11:30 +08:00
lubiao
8626c6ee24
1、SessionHandler类中执行SUBSCRIPTION时,应该先尝试启动runningMonitor再调用embeddedServer的subscribe方法
...
2、embeddedServer的subscribe方法中应该首先进行checkStart操作,否则可能引起metaManager的脏启动
3、SessionHandler中增加日志
2016-10-11 18:46:30 +08:00
lubiao
350f8637c3
1、BinLogFileQueue的listBinlogFiles方法中对binlog文件名进行更严格的验证,必须以数字结尾
...
2、LocalBinLogConnection类中解决如下bug
2.1第二个dump方法中增加代码"decoder.handle(LogEvent.FORMAT_DESCRIPTION_EVENT);",解决"((QueryLogEvent)event).getQuery()"语句出现乱码的问题(BEGIN后面多了4个字节),出现乱码不会进入if语句,导致找到的binlog位点不准确
2.2第一个dump方法中,被注释的decode代码才是正确的,和DirectLogFetcher不同,此处需要构造子循环进行遍历
2.3第一个dump方法中,将每个binlog-file的首个event设置为RotateLogEvent,否则会导致所有event的binlogFileName都是默认的mysql-bin.000001。这么改完之后,和DirectLogFetcher的行为相契合,后者在每个binlogfile的首个event就是RotateLogEvent
3、LocalBinlogEventParser中增加元数据处理的相关代码,不加的话,所有的event都不带列名,基本上没法儿使用
2016-10-11 17:28:24 +08:00
李建安
96454d4387
修复开启checksum后rotateLogEvent数据包解析时binlog name乱码
2016-10-10 18:30:09 +08:00
徐建海
8a293e4b0c
Update AbstractEventParser.java
2016-10-06 19:13:50 +08:00
徐建海
006dd63646
不好的设计
2016-10-06 15:48:05 +08:00
Chuanyi Li
b17c11868c
Fix a minor fault: Canal instance reload again after startup.
2016-10-02 13:43:17 +08:00
李建安
0c9eecd758
mysql5.6.29'@@global.binlog_checksum'带单引号导致master退出,优化binlogFormat判断
2016-09-29 17:21:59 +08:00
agapple
5d9d5b1e44
fixed testcase
2016-09-29 11:43:35 +08:00
agapple
b23e814c48
Merge pull request #203 from kevinKaiF/master
...
fixed issue # 201
2016-09-29 10:31:29 +08:00
zikaifeng
b349b400cf
修复issue # 201
2016-09-27 16:22:48 +08:00
agapple
c86fba6092
Merge pull request #199 from MarkLinHz/master
...
upgrade protobuf version
2016-09-19 14:03:20 +08:00
yinxiu
9742fdc9d9
upgrade protobuf version
2016-09-19 12:24:06 +08:00
agapple
c99b4b8cd1
fixed NPE #200
2016-09-07 12:37:21 +08:00
agapple
aa8ea96572
fixed issue #195
2016-08-26 18:25:52 +08:00
agapple
f6cf88a6bd
support 5.7
2016-08-04 22:53:59 +08:00
agapple
14a5762fbb
support 5.7
2016-08-04 22:53:22 +08:00
agapple
eda24df3fe
fixed kill CONNECTION exception
2016-07-26 10:59:09 +08:00
agapple
3a5a4b06a9
[maven-release-plugin] prepare for next development iteration
2016-06-30 16:59:17 +08:00