wyl/canal
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
1,516 Commits 10 Branches 29 Tags
master
Commit Graph
128 Commits
Author SHA1 Message Date
jianghang.loujh 7b8ff04d20 [maven-release-plugin] prepare for next development iteration 2022-05-24 10:26:12 +08:00
jianghang.loujh 7ee246ca5a [maven-release-plugin] prepare release canal-1.1.6 2022-05-24 10:26:06 +08:00
zhangjukai 25be0259a4 Some tweaks for pulsarmq-connector (#4060) 
* 1. Add the com.alibaba.otter.canal.connector.core.spi.CanalMsgConsumer file to the META-INF/canal directory under the pulsarmq-connector project
2. Introduce pulsar-client-admin for Canal to automatically create multi-partition topics
3. Add the judgment that roleToken is null
4. The disconnect method in CanalPulsarMQConsumer removes this.pulsarMQConsumer.unsubscribe();, this code will cause data loss during stop
5. When getting Pulsar messages, they are all processed as flat messages, because CanalMessageSerializerUtil.deserializer(data) will deserialize exceptions
6. Use groupId as subscriptName, without the pulsarmq.subscriptName parameter, the entire adapter will be the same subscriber name using pulsarmq.subscriptName

* 逻辑优化

* 代码优化

* 针对pulsar的调整

* 恢复代码

* 恢复代码

* 处理Producer失效的情况
 2022-05-13 11:41:50 +08:00
温绍锦 ead91433d7 fastjson update 1.x to 2.0.2 (#4160) 2022-05-13 11:32:47 +08:00
tuple b54bea5e33 polish the code thus make it more stable (#3855) 
Signed-off-by: 元组 <zhaojunwang.zjw@alibaba-inc.com>
 2021-10-11 14:46:22 +08:00
jianghang.loujh 40d840375f fixed MR 2021-10-09 15:59:12 +08:00
Chad2liandagapple 5b6fd8094a 增加Apache Pulsar MQ支持 (#3791) 
* done pulsarmq

* del pulsar consumer

* pulsar partition

* done pulsar consumer&connector

* update pulsar-client version to 2.8.1

Co-authored-by: agapple <jianghang115@gmail.com>
 2021-10-09 15:51:45 +08:00
Jonathan SchneiderandModerne de95a6a128 refactor: Use Java standard library instead of Guava (#3708) 
Co-authored-by: Moderne <team@moderne.io>

Co-authored-by: Moderne <team@moderne.io>
 2021-10-09 15:33:37 +08:00
agapple 5cc85ff2de [maven-release-plugin] prepare for next development iteration 2021-04-19 15:48:20 +08:00
agapple 64862503ba [maven-release-plugin] prepare release canal-1.1.5 2021-04-19 15:48:09 +08:00
文哥 d741425895 升级guava 至 22.0 (#3184) 
* fix issue:#561 增加一个外部参数控制，允许位点不存在时自动重置到当前位点

* Add MariaDB GTID support

* remove client pom bad ns

* upgrade guava version to 22.0
 2020-11-20 13:47:26 +08:00
zavakid e7658879bc = cold cleanup 
* using lambda if possible (we are already building in Java8)
  * using diamond when new generic instance
  * remove used improt
 2020-09-17 17:46:20 +08:00
agapple 5e761e14fa format 2020-02-28 13:15:27 +08:00
rewerma 265a8e8594 模块化mq connector (#2562) 
* add connector module, add kafka producer connector module for server

* add rocketMQ producer connector module for server

* add rabbitMQ producer connector module for server

* optimize code, add annotation

* add canal message consumer connector for canal-adapter module
 2020-02-28 11:00:08 +08:00
rewerma b6333f018f Revert "修复kafka消费回滚的bug (#2521)" (#2526) 
This reverts commit 31acfc0101.
 2020-01-02 17:04:57 +08:00
rewerma 31acfc0101 修复kafka消费回滚的bug (#2521) 2020-01-02 16:15:47 +08:00
耐小心 79552e0a37 rabbitmq(amqp)MQ支持 (#2156) 2019-09-16 12:43:02 +08:00
agapple 2bde4327c7 [maven-release-plugin] prepare for next development iteration 2019-09-02 14:24:16 +08:00
agapple d53bfd7ee7 [maven-release-plugin] prepare release canal-1.1.4 2019-09-02 14:24:03 +08:00
agapple 3d4dbc9a8c fixed issue #2099 , support user/passwd acl and canal admin operator 2019-08-26 18:16:33 +08:00
bucketli c1bfad4f2d 1.not compile canal-admin module,unless you need it, to be optimize.#1998,2.support JDK 11 & 12 ,3.fix the CI block test 2019-07-20 18:12:07 +08:00
Heng Du d0a83aad27 Support seamless docking with Alibaba Cloud RocketMQ commercial service (#1849) 2019-05-27 23:51:32 +08:00
Xin Wang 8cb85753bb open the switch to get codecov test coverage (#1671) 
* add codecov for test coverage
 2019-04-09 19:11:48 +08:00
agapple fadfe1d6ca [maven-release-plugin] prepare for next development iteration 2019-04-04 10:25:44 +08:00
agapple a7b12c7098 [maven-release-plugin] prepare release canal-1.1.3 2019-04-04 10:25:29 +08:00
mcy 579fa72ae2 kafka consumer connector引入事务隔离级别 fix #1512 2019-03-22 13:44:02 +08:00
agapple a81d2710ff fixed MQ partition 2019-03-21 19:27:39 +08:00
rewer 0c5f5c128f 整理代码 2019-02-07 13:49:35 +08:00
mcy a7467539c7 整理server端远程配置, 统一扩展接口 2019-01-25 17:50:50 +08:00
agapple 03e6662ce5 fixed mq 2019-01-08 23:57:16 +08:00
mcy b5697a366a merge 2018-12-23 18:24:04 +08:00
rewerma d5f44dd76f Merge branch 'master' into master 2018-12-23 18:20:33 +08:00
mcy 354d64069f adapter增加同步异常重试 2018-12-23 18:16:47 +08:00
panjianping 990fa9498a 添加 KafkaOffsetCanalConnector 使用示例 2018-12-18 16:46:19 +08:00
panjianping ef72cddfe8 添加带kafka消息offset的Connector 2018-12-18 11:54:41 +08:00
agapple 1b11aa1d21 fixed issue #1220, 解决一下no alive canal server重试过于频繁 2018-12-06 10:31:13 +08:00
mcy f04447837c client打fat包排除其他 2018-11-29 10:21:27 +08:00
agapple 9aaf20fb5e [maven-release-plugin] prepare for next development iteration 2018-11-26 13:22:04 +08:00
agapple 8496ceaf15 [maven-release-plugin] prepare release canal-1.1.2 2018-11-26 13:21:51 +08:00
agapple cc97f3b331 Merge pull request #1171 from rewerma/master 
adapter 分批同步
 2018-11-21 22:09:33 +08:00
mcy 56ec66f90e adapter 分批同步 2018-11-21 13:46:30 +08:00
agapple c0bbe530f1 Merge pull request #1169 from ymwneu/supportRocketMQ 
[ISSUE#1109]Support aliyun RocketMQ
 2018-11-21 12:51:31 +08:00
maowei.ymw 4bfc476e08 Modify rocketMQ related pom 2018-11-21 10:44:58 +08:00
agapple b6f1e0d13c fixed rocketmq ack npe 2018-11-20 17:14:29 +08:00
maowei.ymw 50630cc934 Support client connect rocketmq in aliyun 2018-11-19 14:33:59 +08:00
machey 3090557eeb client 排除jsr305不打进fat jar 2018-11-06 23:16:11 +08:00
mcy dab6fa5aa1 Merge branch 'master' of https://github.com/rewerma/canal 2018-11-05 15:31:41 +08:00
jiacheo 9473f4e8fd Update CanalMessageDeserializer.java 
fix lazyParseEntry 'raw' wrong value.
 2018-11-02 01:48:17 +08:00
mcy e1191b665e es配置加载 2018-10-30 15:57:00 +08:00
mcy e4e23c9ecd 增加adapter相关参数: retry timeout batchSize 2018-10-30 14:13:51 +08:00