agapple
3a74f6124a
fixed issue #1940 #2088 , add canal.register.ip support docker
2019-08-22 23:48:19 +08:00
agapple
bd974e3da8
upgrade fastjson 1.2.58
2019-08-22 23:03:22 +08:00
agapple
86cd805a64
upgrade fastsql 973
2019-08-22 22:02:58 +08:00
agapple
8b54b9e596
add python client info
2019-08-22 15:17:33 +08:00
agapple
2d3baeab7d
fastsql tsdb testcase
2019-08-22 15:08:36 +08:00
黄大海
7b245c5a64
fix #1762 ( #1959 )
2019-08-21 14:33:31 +08:00
agapple
78af6b1130
fixed issue #2067 , add example
2019-08-21 13:52:34 +08:00
ever
7547cac3c5
fix compiler problem: upgrade rocketmq to 4.5.2 ( #2074 )
2019-08-21 12:48:46 +08:00
soocold
066743cfd6
always check whether ringbuffer has an exception in event processor ( #2053 )
2019-08-21 12:46:17 +08:00
rewerma
fdd0763567
新增es adapter rest client和认证机制 ( #2046 )
...
* 新增es adapter rest client和认证机制
* 修改getMapping位置
* 代码调整
* 代码调整
* 整理代码
* fix #2048
2019-08-21 12:44:57 +08:00
ThomasPerkins1123
bcdbf75dc5
Add unit tests for com.alibaba.otter.canal.parse.driver.mysql.utils.ByteHelper ( #2039 )
...
These tests were written using Diffblue Cover.
2019-08-21 12:44:24 +08:00
jason-liew
db23f15b61
fix: hbase etl sql syntax error in some case ( #2034 )
2019-08-21 12:44:04 +08:00
rewerma
44722fe01c
canal-admin-ui 指定profile编译 ( #2019 )
...
* canal-admin-ui 指定profile编译
* 启动实例时选择指定节点
* modify
* modify
* 静态页面修改
2019-07-22 09:15:14 +08:00
bucketli
be9813142f
remove openjdk12
2019-07-20 19:05:49 +08:00
bucketli
c48e80a163
remove oraclejdk8 CI config,add oraclejdk12 and openjdk12
2019-07-20 18:34:01 +08:00
bucketli
c1bfad4f2d
1.not compile canal-admin module,unless you need it, to be optimize.#1998,2.support JDK 11 & 12 ,3.fix the CI block test
2019-07-20 18:12:07 +08:00
rewerma
10f4ef6acd
canal admin ( #1998 )
...
* 增加注解
* modify
* 文件大小写问题
2019-07-16 21:47:53 +08:00
Li Qiang
4c0d82fb98
Update README.md
2019-07-16 20:35:37 +08:00
rewerma
7cec0994e9
Merge branch 'master' into master
2019-07-14 19:24:42 +08:00
mcy
483044916d
canal admin
2019-07-14 19:18:15 +08:00
mcy
c8bb6e200c
modify
2019-07-14 09:59:58 +08:00
mcy
9cc6b67426
ddl sql
2019-07-14 09:59:35 +08:00
mcy
62072ea9ab
modify
2019-07-14 00:06:25 +08:00
mcy
f3daceea6b
canal instance manager module finished
2019-07-13 21:34:44 +08:00
rewerma
4efc0f6078
modify
2019-07-13 18:03:28 +08:00
rewerma
40d2a8c6cc
modify
2019-07-13 14:33:42 +08:00
rewerma
28da536ec8
modify
2019-07-13 11:47:55 +08:00
mcy
6f129bf524
modify
2019-07-12 21:00:33 +08:00
mcy
31ae308760
增减jmx状态控制
2019-07-12 20:59:20 +08:00
mcy
c2ce662f9a
modify
2019-07-12 20:08:16 +08:00
mcy
7044e172f5
jmx 客户端
2019-07-12 20:06:58 +08:00
Menng
c070757da0
修正文档链接&优化格式 #1965 ( #1967 )
2019-07-12 10:13:29 +08:00
xingwenge
92dd2bb189
Update README.md ( #1981 )
2019-07-12 09:53:06 +08:00
rewerma
8639b45fe9
fix #1761 ( #1973 )
...
* Message转Dml对null值的判断
* Message转Dml对null值的判断
* Message转Dml对null值的判断
* fix #1761
2019-07-12 09:52:36 +08:00
mcy
6b9487a0a0
modify
2019-07-12 09:16:10 +08:00
rewerma
5741f5a347
modify
2019-07-12 00:42:18 +08:00
rewerma
4c3ef6772c
modify
2019-07-12 00:01:37 +08:00
rewerma
64824bc5aa
modify
2019-07-11 23:29:49 +08:00
mcy
23209f24ed
增减jmx状态控制
2019-07-11 21:34:12 +08:00
mcy
015026ea91
modify
2019-07-11 21:31:38 +08:00
mcy
c7967e989c
modify
2019-07-11 20:46:02 +08:00
mcy
e4b37f33de
modify
2019-07-11 20:44:39 +08:00
mcy
598f15a404
modify
2019-07-11 16:30:50 +08:00
mcy
ec5f1eb10d
modify
2019-07-11 16:16:32 +08:00
mcy
28c0aac98d
modify
2019-07-11 15:11:29 +08:00
mcy
50ea6870dc
modify
2019-07-11 15:07:57 +08:00
mcy
317439670c
modify
2019-07-11 10:16:12 +08:00
rewerma
64ff140304
modify
2019-07-11 01:05:11 +08:00
rewerma
a93af74539
modify
2019-07-11 00:20:56 +08:00
rewerma
fc39b2af68
modify
2019-07-10 21:46:38 +08:00
mcy
e87a0c3b63
canal-admin init
2019-07-10 16:22:38 +08:00
mcy
b43043f4e4
Merge remote-tracking branch 'origin/master'
2019-07-09 19:09:24 +08:00
mcy
60a46ae941
fix #1761
2019-07-09 19:08:35 +08:00
Braavos
b5c05c2fd2
Add unit tests for com.alibaba.otter.canal.parse.driver.mysql.utils.MySQLPasswordEncrypter ( #1937 )
...
These tests were written using Diffblue Cover.
2019-06-28 14:57:18 +08:00
靳光宇
0cf18976d9
Update HbaseSyncService.java ( #1936 )
...
Fix batch update or delete with only affects the first data issue
2019-06-28 14:56:51 +08:00
Li Qiang
803c0607d3
Update README.md
2019-06-27 19:45:26 +08:00
Li Qiang
f04e742f4f
#1897 , fix DummyEventStore implements new method ( #1932 )
2019-06-27 09:58:24 +08:00
cjk87927
c81034dda3
增加表字段过滤功能 ( #1914 )
...
* 增加表字段过滤功能
* 增加表字段过滤功能
* 更换fastsql版本通过编译
* 1.修改字段配置格式 2.增加字段黑名单配置(冲突时以白名单为准)
2019-06-26 17:45:14 +08:00
agapple
a847660a45
fixed issue #1826 , remove kafka transaction send
2019-06-26 16:02:19 +08:00
agapple
4957083493
fixed issue #1897 , memory event store ack null
2019-06-25 17:32:46 +08:00
rewerma
24f0eece42
Merge pull request #1 from alibaba/master
...
merge
2019-06-19 21:00:31 +08:00
agapple
adccc0e912
add logger info for query_log_event
2019-06-19 15:04:22 +08:00
agapple
8728beb4b6
fixed compile
2019-06-18 22:18:30 +08:00
agapple
5bea876ec9
fixed issue #1352 , add pkNames for flatMessage partition
2019-06-18 21:44:52 +08:00
agapple
6c494f8892
add rocketmq-client pom version
2019-06-18 21:28:55 +08:00
BillowX
74489d1bba
当MQ配置为Kafka时,支持配置Kerberos认证 ( #1895 )
2019-06-18 15:02:14 +08:00
Z6N
5ac0f7b710
按主键散列,未设置主键时无限空指针异常 ( #1889 )
...
当按注解散列时,如果监控的表未显示设置主键,将会导致flatMessage.getPkNames()为空,导致无限空指针异常
2019-06-18 15:01:00 +08:00
lanxinxu
75b4911caf
线程安全的获取meta ( #1866 )
2019-06-18 14:59:30 +08:00
lanxinxu
95602f4784
并行解析模式下有丢数据风险 ( #1857 )
2019-06-18 14:57:59 +08:00
agapple
058e1fc546
fixed delete message send mq bugfix
2019-05-28 00:14:20 +08:00
lulu2panpan
e808c6ec70
AbstractCanalInstance的subscribeChange方法,增加对AbstractEventParser的类型判断;MysqlEventParser对Gtid的处理需要考虑兼容性 ( #1824 )
...
* AbstractCanalInstance的subscribeChange方法,增加对AbstractEventParser的类型判断,以支持用户的自定义CanalEventParser
* MysqlEventParser对Gtid模式的处理需要考虑兼容性,支持系统平滑的从非gtid模式升级为gtid模式
2019-05-28 00:05:13 +08:00
rewerma
ce7948d6e7
fix Message转Dml对null值的bug ( #1808 )
...
* Message转Dml对null值的判断
* Message转Dml对null值的判断
* Message转Dml对null值的判断
2019-05-28 00:03:55 +08:00
soso
8df6d6fed8
Fix: 主备切换后没有往Kafka发送数据 ( #1810 )
...
发生主备切换时,调用canalMQStarter启停对应的destination。
2019-05-28 00:03:28 +08:00
nieyuan1991
f9989e0856
fix:未捕获kafka事务异常,造成canal ack异常 ( #1814 )
2019-05-28 00:02:25 +08:00
xiayuan
4075a0623f
set the validationQuery while testWhileIdle is true ( #1827 )
2019-05-27 23:56:25 +08:00
Marsss___
37fc248ebf
删除操作计算hash值的情况没有考虑,导致删除时的分区和插入时的分区不一致 ( #1848 )
2019-05-27 23:54:25 +08:00
Heng Du
d0a83aad27
Support seamless docking with Alibaba Cloud RocketMQ commercial service ( #1849 )
2019-05-27 23:51:32 +08:00
agapple
3b9ff26d1a
add logo
2019-05-15 10:20:08 +08:00
mcy
4f7842c843
Message转Dml对null值的判断
2019-05-14 17:38:01 +08:00
mcy
b870e7ecd0
Message转Dml对null值的判断
2019-05-14 17:35:34 +08:00
mcy
331dd63c5f
Message转Dml对null值的判断
2019-05-14 17:31:51 +08:00
JKTerrific
72c4daba5f
1:添加对于查询结果中,MAX( CASE a.key WHEN 'WORD1' THEN a.value ELSE 0 END ) AS… ( #1794 )
...
* 1:添加对于查询结果中,MAX( CASE a.key WHEN 'WORD1' THEN a.value ELSE 0 END ) AS WORD1 的竖表转横表的支持
2:添加对于查询条件尾部,使用GROUP BY _id 等分组语句时出现的sql解析异常问题
* fix index out of range
2019-05-11 17:33:59 +08:00
Jet
7427a74612
improve es etl ( #1758 )
...
* fix typo in trace log
* improve es etl
* improve es etl log
* improve es etl by add threadCount
* improve es etl by add threadCount
* improve es etl query
* remove comment
2019-05-11 17:26:08 +08:00
paascloud
24fae6fa52
变量定义错误 ( #1776 )
...
* 变量定义错误
* 变量定义错误
2019-05-11 17:21:21 +08:00
Sweet
4c690fb5a3
Null point Exception during loading the checksum ( #1788 )
...
If you connect to the mysql with version 5.1, the result of command 'select @master_binlog_checksum' is an array with only one Null element .
2019-05-11 17:17:54 +08:00
Jet
8f088cddc0
Fix es bulk ( #1743 )
...
thanks
2019-04-25 09:36:09 +08:00
Jet
e94ee64316
fix typo in trace log ( #1738 )
2019-04-24 09:57:05 +08:00
dataccs
3165cb9640
支持用户自定义的CanalAlarmHandler ( #1736 )
...
* 支持用户自定义的CanalAlarmHandler
* RowsLogEvent增加对TableMapLogEvent判空检查,防止NPE异常
2019-04-24 09:56:32 +08:00
rewerma
2b738f4e04
fix bugs ( #1712 )
...
* kafka 模式默认开启事务异步发送
* fix adapter etl rest sql inject bug
* fix #1704
2019-04-18 20:33:15 +08:00
rewerma
16f335c381
修复rest etl 存在SQL注入风险 ( #1685 )
...
* kafka 模式默认开启事务异步发送
* fix adapter etl rest sql inject bug
2019-04-15 23:58:12 +08:00
王超
a8bf2b641f
String.split(String regex) bug fix ( #1696 )
2019-04-15 23:55:03 +08:00
chenxyz707
67faf0e03e
resovle config/metrics as a destination folder ( #1678 )
2019-04-09 21:05:42 +08:00
Xin Wang
8cb85753bb
open the switch to get codecov test coverage ( #1671 )
...
* add codecov for test coverage
2019-04-09 19:11:48 +08:00
agapple
df86f94409
fixed issue template
2019-04-09 15:12:30 +08:00
agapple
80594444f7
fixed issue template
2019-04-09 15:11:14 +08:00
agapple
d8996432b9
add issue template
2019-04-09 15:08:43 +08:00
agapple
69df50fe17
fixed issue #1672 , CanalKafkaProducer send
2019-04-08 19:57:00 +08:00
agapple
c5736bd5f3
Merge pull request #1670 from lovepoem/update_compile_jdk
...
update jacoco lib
2019-04-08 12:28:27 +08:00
Xin Wang
55030476ee
reverse jdk to 1.8
2019-04-07 19:14:46 +08:00
Xin Wang
cd007088db
reverse jdk to 1.8
2019-04-07 18:52:35 +08:00
Xin Wang
1fc880f255
reverse jdk to 1.7
2019-04-07 18:45:54 +08:00
Xin Wang
8c68cf833a
update jacoco lib
2019-04-07 18:38:50 +08:00
Xin Wang
0de8f4691e
update jacoco lib
2019-04-07 18:25:05 +08:00
Xin Wang
5a2efbf9cb
update jacoco lib
2019-04-07 18:23:53 +08:00
agapple
dfab98fce1
Merge pull request #1669 from lovepoem/add_test_coverage_and_jdk11
...
add test coverage and jdk11
2019-04-06 23:37:40 +08:00
Xin Wang
e5c7bbffbf
update pom
2019-04-06 18:13:41 +08:00
Xin Wang
e139698f6e
update pom
2019-04-06 17:50:05 +08:00
Xin Wang
2b8120b6ed
update pom
2019-04-06 17:49:03 +08:00
Xin Wang
68ebb3a957
update skipTests=false
2019-04-06 17:35:16 +08:00
Xin Wang
21309cb065
resove Could not resolve dependencies for project com.alibaba.otter:client-adapter.hbase:jar:1.1.4-SNAPSHOT: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path
2019-04-06 17:23:48 +08:00
Xin Wang
386567a633
resove Could not resolve dependencies for project com.alibaba.otter:client-adapter.hbase:jar:1.1.4-SNAPSHOT: Could not find artifact jdk.tools:jdk.tools:jar:1.7 at specified path
2019-04-06 16:56:03 +08:00
Xin Wang
95c69bb854
add test coverage and jdk11
2019-04-06 16:45:04 +08:00
Xin Wang
6febcf1a0f
add test coverage and jdk11
2019-04-06 16:42:45 +08:00
agapple
fadfe1d6ca
[maven-release-plugin] prepare for next development iteration
2019-04-04 10:25:44 +08:00
agapple
a7b12c7098
[maven-release-plugin] prepare release canal-1.1.3
2019-04-04 10:25:29 +08:00
agapple
2c320e8618
Merge pull request #1661 from rewerma/master
...
flatMessage模式下默认canal.mq.lingerMs=100
2019-04-04 10:08:34 +08:00
machey
d76d25df6c
flatMessage模式下默认canal.mq.lingerMs=100
2019-04-04 00:14:27 +08:00
agapple
b95c0d03cf
fixed issue #1660 ,support mysql8.0 caching_sha2_password auth
2019-04-03 23:42:41 +08:00
agapple
08af40221f
Merge pull request #1658 from rewerma/master
...
adapter 日志打印修改
2019-04-03 12:12:56 +08:00
rewerma
d13c1eb17c
Merge branch 'master' into master
2019-04-03 11:34:10 +08:00
agapple
82ed9db8ae
fixed rocketmq partition out of range
2019-04-03 11:26:31 +08:00
agapple
d3195ac973
fixed issue #1626 , support alter table id first
2019-04-03 10:58:43 +08:00
agapple
15e29d276a
fixed default xml config
2019-03-28 22:05:56 +08:00
agapple
d715ff64b4
fixed packet write batch
2019-03-28 21:52:51 +08:00
agapple
f63ce4ffe6
fixed mysql auth
2019-03-28 20:45:16 +08:00
agapple
a7f9a779ad
fixed issue #1640 , support schema partition
2019-03-28 17:01:36 +08:00
agapple
39aeeb8c58
Merge pull request #1641 from wangsaner/master
...
修改canal.mq.partitionHash散列规则,使其支持同库下的不同表hash至相同分区
2019-03-28 16:58:31 +08:00
wangsaner
9826948ebb
修改canal.mq.partitionHash散列规则,
...
当指明pk级做分区(schema.table:pk1^pk2)时,由table.hashCode()^column.getValue().hashCode()改为database.hashCode()^column.getValue().hashCode(),从而支持同库下不同表hash至相同分区
2019-03-28 16:01:02 +08:00
wangsaner
d6ef66a281
Merge pull request #1 from alibaba/master
...
merge
2019-03-28 10:37:24 +08:00
agapple
97640b717b
fixed compiler
2019-03-28 10:23:33 +08:00
agapple
20e7becfe9
fixed format
2019-03-28 10:19:53 +08:00
agapple
99b34ff632
Merge pull request #1639 from wangsaner/master
...
fixed issue #1636
2019-03-28 10:17:42 +08:00
wangsaner
739963acd0
fixed issue #1636
...
非flat模式,当MQ主题为多分区时,数据拆分只取了for循环里面的最后一份数据,
导致消费端只能消费到一个分区的数据
2019-03-27 21:57:04 +08:00
agapple
0ec4699149
fixed format & support Mysql Auth Switch Protocol
2019-03-27 11:54:40 +08:00
mcy
c101ae2280
Merge branch 'master' of https://github.com/rewerma/canal
2019-03-26 11:39:41 +08:00
mcy
a137deeaff
使用统一log
2019-03-26 11:29:52 +08:00
rewerma
c5be5b7a8a
Merge pull request #40 from alibaba/master
...
merge
2019-03-26 00:43:11 +08:00
agapple
95bed6bcf6
fixed fastsql
2019-03-25 19:50:02 +08:00
agapple
661d119265
fixed issue #1625 , mq dymaic topic match
2019-03-25 17:54:35 +08:00
agapple
08167c95c7
Merge pull request #1622 from rewerma/master
...
fix bugs
2019-03-22 18:14:14 +08:00
mcy
37c5168a7d
code optimization
2019-03-22 14:49:50 +08:00
mcy
579fa72ae2
kafka consumer connector引入事务隔离级别 fix #1512
2019-03-22 13:44:02 +08:00
rewerma
844c019433
Merge pull request #39 from alibaba/master
...
merge
2019-03-22 09:10:43 +08:00
agapple
c94e3a0024
fixed default properties
2019-03-21 20:59:09 +08:00
agapple
f6ca489984
Merge pull request #1620 from rewerma/master
...
fix bugs
2019-03-21 20:51:10 +08:00
agapple
b2b69307f9
fixed rocketmq
2019-03-21 20:50:52 +08:00
agapple
531b535228
fixed bug
2019-03-21 20:26:00 +08:00
mcy
99cccd2113
fix #1608
2019-03-21 20:07:06 +08:00
rewerma
38d8c3d462
Merge branch 'master' into master
2019-03-21 19:42:07 +08:00
agapple
024ffc2aa2
fixed mq partition num priority
2019-03-21 19:39:21 +08:00
agapple
a81d2710ff
fixed MQ partition
2019-03-21 19:27:39 +08:00
mcy
4bad0e88f8
增加日志配置 fix #1570
2019-03-21 19:04:33 +08:00
mcy
0181dfaa42
sql解析对case when 的支持
...
fix #1598
2019-03-21 18:35:58 +08:00
rewerma
0411d99e7b
Merge pull request #37 from alibaba/master
...
merge
2019-03-21 18:07:41 +08:00
agapple
8fcdd7f798
Merge pull request #1619 from rewerma/master
...
fix #1608
2019-03-21 17:58:57 +08:00
mcy
b0f4e4ee78
fix #1608
2019-03-21 17:55:35 +08:00
agapple
d448455ebf
Merge pull request #1613 from KangZhiDong/master
...
set utf8mb4 to support emoji
2019-03-21 16:49:44 +08:00
agapple
e07fdb6426
Update README.md
2019-03-21 16:46:42 +08:00
agapple
38336b249e
fixed travis
2019-03-21 16:36:41 +08:00
agapple
e7b81cd83a
fixed mvn wrapper
2019-03-21 16:30:05 +08:00
agapple
2810e7e815
add mvnw
2019-03-21 16:20:13 +08:00
agapple
024986a195
fixed travlis.yml
2019-03-21 16:16:31 +08:00
kangzhidong
9b2ad0eafd
set utf8mb4 to support emoji
2019-03-20 16:29:53 +08:00
康智冬
03d46f150f
Merge pull request #2 from alibaba/master
...
update
2019-03-20 16:21:38 +08:00
agapple
b488ca02d8
fixed travlis
2019-03-20 13:55:29 +08:00
agapple
17a6ba9c9c
fixed travlis
2019-03-20 13:44:29 +08:00
agapple
3b618740d4
Merge pull request #1607 from rewerma/master
...
ES同步新增父子文档索引适配
2019-03-20 13:35:25 +08:00
mcy
06bfcda275
code optimization
2019-03-20 10:41:51 +08:00
mcy
5821c1f606
modify
2019-03-20 09:10:15 +08:00
mcy
a2360efff9
增加对sql字段 `` 的支持
...
fix #1559
2019-03-19 19:13:15 +08:00
mcy
51c469aa6f
es etl 主键类型bug fix #1559
2019-03-19 17:54:11 +08:00
mcy
6b3bf31404
adapter代码整理优化
2019-03-19 17:49:00 +08:00
mcy
941ed7f60d
Merge branch 'feature/es2'
2019-03-18 09:06:58 +08:00
rewerma
9db2bd291b
Merge pull request #36 from alibaba/master
...
merge
2019-03-18 09:05:47 +08:00
agapple
95b26c4d1d
fixed #1433 , optimzier code
2019-03-17 10:35:16 +08:00
agapple
b114e0cb15
Merge pull request #1581 from alexinea/master
...
CanalSharp has transferred to .NET Core Community
2019-03-17 10:30:03 +08:00
agapple
5c96bf282e
Merge pull request #1590 from rewerma/master
...
fix #1585
2019-03-17 10:29:12 +08:00
agapple
6d280d1048
Merge pull request #1597 from KangZhiDong/master
...
fix the error log does not contain table name
2019-03-17 10:28:47 +08:00
agapple
cf4db1625d
Merge pull request #1605 from lizhyocx/master
...
解决单核服务器无法订阅数据的bug
2019-03-17 10:27:50 +08:00
lizhyocx
df98fec945
解决单核服务器无法订阅数据的bug
...
解决单核服务器c中anal.instance.parser.parallel = true时无法订阅数据的bug
2019-03-15 17:11:14 +08:00
mcy
e03705e211
es父子文档索引ETL支持
2019-03-13 17:19:08 +08:00
mcy
4df60a0fb5
es增加父子文档索引同步适配
2019-03-13 16:57:23 +08:00
kangzhidong
078673c6a9
fix the error log does not contain table name
2019-03-13 16:55:38 +08:00
mcy
4bd91a1079
fix bug
2019-03-13 14:36:27 +08:00
mcy
05ad671cc1
es增加relations配置
...
配置monitor yml加载使用通用加载类
2019-03-13 14:34:31 +08:00
mcy
43045bc672
use system time zone for es datetime field formatter
2019-03-13 10:01:16 +08:00
mcy
971c9a88c2
modify
2019-03-12 17:07:33 +08:00
rewerma
7b6e482827
Merge pull request #35 from alibaba/master
...
merge
2019-03-12 16:58:05 +08:00
mcy
ad39559f8c
fix #1585
2019-03-12 16:56:59 +08:00
AlexLEWIS
2707c12570
CanalSharp has transferred to .NET Core Community
...
CanalSharp has transferred to .NET Core Community(NCC) and became a member project of NCC.
2019-03-11 14:47:14 +08:00
康智冬
7dab5ac6c2
Merge pull request #1 from alibaba/master
...
update
2019-03-08 10:05:20 +08:00
agapple
9d4b61f083
Merge pull request #1567 from dragontree101/miss_producergroup_properties
...
producerGroup配置没有读取
2019-03-06 11:07:15 +08:00
dragonlong1986
a34f9ae97b
Merge branch 'master' into miss_producergroup_properties
2019-03-05 17:44:35 +08:00
dragonlong1986
64ca62b986
update
2019-03-05 17:39:56 +08:00
agapple
14c1af4c80
Merge pull request #1542 from rewerma/master
...
fixed #1538
2019-03-04 14:13:14 +08:00
agapple
7436d9f06f
Merge pull request #1550 from lee123lee123/master
...
Issues #1460 修改tsdb中同步数据带表情字符错误问题
2019-03-04 14:12:33 +08:00
agapple
c4599df1c2
Merge pull request #1560 from dragontree101/doc_mistake_key
...
key改成大写,小写不会生效
2019-03-04 14:07:22 +08:00
dragonlong1986
7abf50f233
key改成大写,小写不会生效
2019-03-02 10:25:19 +08:00
machey
1781381187
modify
2019-03-01 00:19:47 +08:00
machey
5d4210bd22
modify
2019-02-28 23:31:07 +08:00
machey
9888fae559
负时区的bug
2019-02-28 23:22:02 +08:00
rewerma
81ab7e9783
Merge branch 'master' into master
2019-02-28 19:37:27 +08:00
mcy
b891afa50e
增加时区判断
2019-02-28 19:28:17 +08:00
lee123lee123
8187d7c5df
Issues #1460 修改utf8数据带表情字符错误
2019-02-28 19:04:14 +08:00
mcy
e7f069850f
fixed #1538
2019-02-28 17:29:06 +08:00
agapple
d377a92a5d
fixed issue #1548 , NPE
2019-02-28 10:52:28 +08:00
agapple
f664af1af4
fixed issue #1546 , support drop database
2019-02-28 10:47:42 +08:00
agapple
5e2eabb3c2
Merge pull request #1544 from finefuture/MQ-fix-pr
...
fix issue 1532
2019-02-28 10:32:41 +08:00
agapple
f2368e5469
Merge pull request #1540 from wurongjun/master
...
修复当适配器mapping文件修改时,无法生效的问题
2019-02-28 10:32:07 +08:00
TomlongTK
fd4c8db92b
fix issue 1532
...
因为binlog日志同表名大小写的原因导致kafka的日志恢复并resize,报错之后引起集群崩溃
现在修改为投递消息的topic不区分表名大小写
2019-02-26 14:23:29 +08:00
mcy
f21abc13af
fixed #1538
2019-02-26 10:23:38 +08:00
wurongjun@duiba.com.cn
ae474d67ad
修复当适配器mapping文件修改时,无法生效的问题
2019-02-25 17:53:30 +08:00
bigbro
0c4711ab62
Merge pull request #2 from alibaba/master
...
合并原项目最新代码
2019-02-25 17:51:19 +08:00
agapple
072420c32b
fixed
2019-02-25 15:18:04 +08:00
agapple
1473a4a6b5
Merge pull request #1523 from rewerma/master
...
es adapter新增upsert属性
2019-02-25 14:50:58 +08:00
agapple
0fff514876
Merge pull request #1533 from DaiZZZZZ/master
...
CanalParameter添加parallel参数,用来配置canalinstance
2019-02-25 14:45:54 +08:00
agapple
4017de5102
Merge pull request #1526 from jiuchengspotorg/master
...
adapter rdb无法同步ddl更新问题修正
2019-02-25 14:15:47 +08:00
mcy
fcc1fc78ae
fix #1521
2019-02-22 17:09:50 +08:00
mcy
17efc2ada0
es 批量提交修改
2019-02-22 16:56:58 +08:00
zhikuodai
a68bd28852
CanalParameter类添加parallel参数
2019-02-21 22:04:06 +08:00
daizzzzz
1de8b27da1
Merge pull request #3 from alibaba/master
...
merge
2019-02-21 17:25:55 +08:00
mcy
01dc8ce2b8
YmlConfigBinder代码整理
2019-02-20 15:00:48 +08:00
jiucheng
f7e490f7a0
1、adapter/rdb,从库表字段(varchar,char,text,longtext)非空约束时,无法同步问题修正
...
2、主库存在0000-00-00 00:00:00时间时,从库表字段是非空约束时,无法同步问题修正
2019-02-20 10:10:14 +08:00
jiucheng
8cadd585c6
adapter rdb无法同步ddl更新问题修正
...
adapter/support/MessageUtil.java
2019-02-20 09:49:15 +08:00
mcy
57c3226e56
Merge branch 'feature/es2'
2019-02-19 15:05:59 +08:00
rewerma
79a3961da1
Merge pull request #34 from alibaba/master
...
merge
2019-02-19 15:05:34 +08:00
agapple
62338a945e
Merge pull request #1496 from rewerma/master
...
远程配置代码整理
2019-02-18 21:08:02 +08:00
agapple
e07db7b178
Merge pull request #1507 from i404/master
...
修复 FlatMessage Hash 到不正确的分区的Bug。
2019-02-18 21:05:03 +08:00
mcy
05cc627b5d
fix rdb etl bug
2019-02-15 11:39:26 +08:00
i404
44beaf1916
修复当 canal.mq.flatMessage = true 时,MQMessageUtils::messagePartition 数据分区错误的 bug
2019-02-14 18:26:01 +08:00
mcy
476244b26d
modify
2019-02-14 15:41:27 +08:00
mcy
cfdf509f9a
增加对pk的支持
2019-02-14 15:29:27 +08:00
mcy
c14ed724ff
update中增加upsert判断
2019-02-13 15:59:46 +08:00
mcy
5a4cfeab46
Merge branch 'master' into feature/es2
...
# Conflicts:
# client-adapter/elasticsearch/src/main/java/com/alibaba/otter/canal/client/adapter/es/support/ESTemplate.java
2019-02-13 15:51:24 +08:00
mcy
947cf130ab
fixed #1504
2019-02-13 15:50:11 +08:00
mcy
0ef21e4155
代码整理
2019-02-13 15:47:48 +08:00
mcy
83b760494d
ES adapter代码重新整理
...
新增upsert属性
2019-02-13 15:19:09 +08:00
mcy
aba8df699c
Merge branch 'master' into feature/es2
...
# Conflicts:
# client-adapter/elasticsearch/src/main/java/com/alibaba/otter/canal/client/adapter/es/config/SchemaItem.java
2019-02-12 17:21:42 +08:00
rewer
0c5f5c128f
整理代码
2019-02-07 13:49:35 +08:00
mcy
ad62275cd7
增加kafka自定义properties
2019-02-05 19:20:36 +08:00
mcy
f6d03bcb37
fixed #1490
2019-02-05 17:48:08 +08:00
mcy
5284aa9793
fix bugs
2019-02-01 16:20:53 +08:00
mcy
10276e254a
mq模式下adapter配置增加groupId属性对应
2019-02-01 15:18:16 +08:00
mcy
597a08ac37
通过groupId过滤对应的adapter配置
2019-02-01 13:51:49 +08:00
mcy
8211ef35e6
修改yml配置读取绑定,遵循spring yml加载方式,支持environment级占位符替换
2019-02-01 10:11:52 +08:00
mcy
a20960834b
远程配置代码整理
2019-01-31 09:45:52 +08:00
rewerma
7b6b332463
Merge pull request #33 from alibaba/master
...
merge
2019-01-31 09:03:37 +08:00
agapple
43f869599d
Merge pull request #1484 from liulangwa/master
...
捕获"rs = query("select @@global.binlog_checksum")" 结果rs为null的异常
2019-01-30 11:45:33 +08:00
agapple
e3d05f6201
Merge pull request #1482 from wurongjun/master
...
修复从数据库加载配置写入文件时因目录不存在出现的问题
2019-01-30 11:43:47 +08:00
codebee
032301102c
捕获"rs = query("select @@global.binlog_checksum")" 结果rs为null的异常
2019-01-29 17:10:26 +08:00
wurongjun@duiba.com.cn
bb64d84298
修复从数据库加载配置写入文件时因目录不存在出现的问题
2019-01-29 16:10:26 +08:00
bigbro
ccd39e9d62
Merge pull request #1 from alibaba/master
...
update
2019-01-29 16:03:43 +08:00
agapple
32031da9db
Merge pull request #1475 from rewerma/master
...
整理远程配置, 统一扩展接口
2019-01-29 10:13:03 +08:00
mcy
9a2e890f57
整理adapter端远程配置, 统一扩展接口
2019-01-25 18:50:30 +08:00
mcy
8f76b33214
解析配置修改
2019-01-25 17:51:38 +08:00
mcy
a7467539c7
整理server端远程配置, 统一扩展接口
2019-01-25 17:50:50 +08:00
agapple
db5495d158
Merge pull request #1464 from KangZhiDong/master
...
修改注释
2019-01-25 10:41:40 +08:00
kangzhidong
b04d948064
修改注释
2019-01-23 11:58:07 +08:00
agapple
5f8eb4d261
Merge pull request #1456 from rewerma/master
...
新增kafka消息投递事务
2019-01-21 23:45:13 +08:00
mcy
197ca67c8b
测试调整
2019-01-21 09:56:35 +08:00
machey
851637611f
modify
2019-01-20 15:02:06 +08:00
machey
4ebf17f57b
代码调整
2019-01-20 14:30:20 +08:00
machey
2f214ce3a6
采用事务批量异步投递kafka flatMessage
...
fixed #1454
2019-01-20 14:20:06 +08:00
agapple
8d4fbb395b
fixed issue #1451 , fixed NPE
2019-01-18 11:00:02 +08:00
agapple
d935c39648
Merge pull request #1449 from wdlily/master
...
fixed a word
2019-01-18 10:24:01 +08:00
wdlily
6e0e3fbef1
fixed a word
...
change '租' to '组'
2019-01-17 15:52:24 +08:00
rewerma
cbe88af2e3
Merge pull request #1442 from rewerma/master
...
fixed #1430
2019-01-17 15:18:40 +08:00
mcy
ba9d9dea6d
fixed #1433
2019-01-17 11:27:12 +08:00
mcy
2d88d803ee
merge #1440 and fixed #1430
2019-01-17 10:52:27 +08:00
rewerma
ff1fef1eb6
Merge pull request #32 from alibaba/master
...
merge
2019-01-17 10:48:23 +08:00
rewerma
4beb1e6855
Merge branch 'master' into master
2019-01-17 10:48:14 +08:00
rewerma
d2bbe9b061
Merge pull request #1440 from wurongjun/master
...
fix #1430
2019-01-17 10:46:30 +08:00
rewerma
171bedf488
Merge pull request #31 from alibaba/master
...
merge
2019-01-17 10:43:49 +08:00
mcy
e387cfdee5
fixed #1430
2019-01-17 10:22:08 +08:00
wurongjun@duiba.com.cn
47d7914304
停机时清空zk客户端信息,修复重启时报出的zk连接已关闭的异常
2019-01-16 17:28:51 +08:00
agapple
e4177ab0ce
Merge pull request #1419 from rewerma/master
...
specified mq dynamic topic
2019-01-16 10:27:25 +08:00
mcy
739f3b4fa1
fixed #1433
2019-01-15 18:39:32 +08:00
mcy
60441d8b31
fixed #1396
2019-01-15 18:20:05 +08:00
mcy
ca41be8412
fixed #1420
2019-01-15 11:38:00 +08:00
mcy
18b304f99d
specified mq dynamic topic
2019-01-14 14:25:47 +08:00
agapple
7f9dce4b77
Merge pull request #1418 from rewerma/master
...
fixed #1416
2019-01-14 13:10:32 +08:00
mcy
f26adff7c7
fixed #1416
2019-01-14 11:16:33 +08:00
mcy
77646c0185
拼写错误
2019-01-14 10:58:33 +08:00
agapple
7e4912cd2e
Merge pull request #1413 from wingerx/master
...
获取TableMeta信息时,增加一次retry操作
2019-01-12 11:26:30 +08:00
agapple
70a4f0363d
Merge pull request #1412 from rewerma/master
...
fixed #1408 fixed # 1403
2019-01-12 11:26:11 +08:00
winger
725960d46e
获取TableMeta信息时,增加一次retry操作
2019-01-11 14:00:15 +08:00
mcy
b00d347eb0
rdb adapter 增加 truncate dml适配 fixed #1408
...
fixed #1403
2019-01-11 13:40:37 +08:00
rewerma
92666b41e8
Merge pull request #30 from alibaba/master
...
merge
2019-01-11 12:59:01 +08:00
agapple
f1753e79f9
Merge pull request #1407 from lileibuaa/master
...
fix filter transaction entry logic in EntryEventSink
2019-01-11 10:29:06 +08:00
lileibuaa
f1a998b2d5
fix filter transaction entry logic in EntryEventSink
2019-01-10 21:16:25 +08:00
agapple
03e6662ce5
fixed mq
2019-01-08 23:57:16 +08:00
agapple
b845a67666
Merge pull request #1391 from rewerma/master
...
fixed 1390
2019-01-08 23:42:57 +08:00
mcy
690222bde8
dynamic topic 正则注释
2019-01-08 11:28:29 +08:00
mcy
63ad80c8c4
fixed 1390
2019-01-08 10:39:32 +08:00
agapple
de501c85a1
fixed issue #1374 , support queryLogEvent partition
2019-01-07 13:39:04 +08:00
agapple
670b7830a5
Merge pull request #1383 from rewerma/master
...
增加adapter远程配置
2019-01-07 13:31:01 +08:00
agapple
fdf150bd24
fixed issue #1341
2019-01-07 13:28:48 +08:00
agapple
c66b6a0f0f
fixed charset
2019-01-07 12:59:33 +08:00
machey
a91aebafc2
modify
2019-01-06 21:08:17 +08:00
machey
35fcd56822
Merge branch 'feature/mgr'
...
# Conflicts:
# client-adapter/rdb/src/main/java/com/alibaba/otter/canal/client/adapter/rdb/monitor/RdbConfigMonitor.java
2019-01-05 01:53:42 +08:00
machey
a63e982115
添加注释
2019-01-05 01:51:43 +08:00
machey
4bdf3d766f
modify
2019-01-05 01:44:04 +08:00
machey
779ebad890
adapter 远程配置
...
修改rdb热加载配置的问题
2019-01-05 01:42:27 +08:00
agapple
b348260288
fixed issue #1363 , date format
2019-01-03 11:48:33 +08:00
agapple
3011c3292b
Merge pull request #1362 from rewerma/master
...
fixed #1359
2019-01-02 22:42:22 +08:00
mcy
94b8fdbbf4
动态topic的xml配置
2019-01-02 13:28:27 +08:00
mcy
1dd9934f9c
fixed #1359
2019-01-02 13:23:32 +08:00
mcy
3dec7c50ce
commit
2019-01-02 11:05:46 +08:00
machey
ecd9ababa1
modify
2019-01-01 17:55:23 +08:00
machey
b0eaa156cc
增加adapter远程配置
2019-01-01 17:33:01 +08:00
agapple
a70178afef
Merge pull request #1357 from rewerma/master
...
canal server配置统一数据库管理监控
2018-12-31 12:16:21 +08:00
machey
114c3bd020
modify
2018-12-30 17:16:47 +08:00
machey
f9e19d46c4
增加注释
2018-12-30 17:08:11 +08:00
machey
661752096c
增加注释
2018-12-30 17:04:15 +08:00
machey
100b43a5db
Merge branch 'feature/mgr'
2018-12-30 16:50:32 +08:00
rewerma
5e116de264
Merge pull request #29 from alibaba/master
...
merge
2018-12-30 16:50:05 +08:00
machey
a1091368fb
modify
2018-12-30 16:47:35 +08:00
machey
71b7c0b868
canal server增加数据库远程配置
2018-12-30 16:44:35 +08:00
mcy
7c79714528
增加远程db config配置
2018-12-29 20:21:03 +08:00
agapple
8d84521767
Merge pull request #1355 from rewerma/master
...
adapter 分组间线程统一抛异常
2018-12-28 23:06:08 +08:00
agapple
14ba358525
fixed dymaic topic
2018-12-28 18:35:50 +08:00
mcy
7ea1468a8d
adapter 分组间线程统一抛异常
2018-12-28 17:30:04 +08:00
agapple
f72ac9a3bb
fixed adapter throw exception
2018-12-28 16:55:44 +08:00
agapple
f100aeda39
Merge pull request #1345 from rewerma/master
...
fixed 1341
2018-12-28 15:22:20 +08:00
agapple
953a0d0583
Merge pull request #1349 from mujiansu/master
...
fix bat syntax error
2018-12-28 15:20:05 +08:00
agapple
2afe7debda
Merge pull request #1305 from wingerx/master
...
修复同时开启gtid与tsdb 时gtid 属性丢失的问题
2018-12-28 15:13:47 +08:00
agapple
d8737a5228
fixed issue #1343 , support charset 255
2018-12-28 13:46:50 +08:00
mcy
150a13824b
修改 kafka 异步发送 flat message
2018-12-27 17:52:33 +08:00
JasonMu
830e149d0e
fix bat syntax error
2018-12-27 16:41:15 +08:00
mcy
d9e259dde4
增加支持按库名、表名动态发送topic支持
2018-12-27 15:40:04 +08:00
mcy
9e6adff942
修复adapter无法回退的问题,fixed 1341
...
修复HBase断连的问题
2018-12-26 15:24:30 +08:00
winger
82a78546ab
Merge remote-tracking branch 'upstream/master'
2018-12-26 15:11:17 +08:00
winger
19c35c0b08
修复:当mysql 发生过purged gtid时,同时开启tsdb与gtid后,gtid属性丢失问题
2018-12-26 15:10:57 +08:00
agapple
ade2a54369
Merge pull request #1340 from rewerma/master
...
fixed #1338
2018-12-25 22:42:25 +08:00
machey
dffbc437a6
fixed #1338
2018-12-25 22:27:27 +08:00
mcy
b5697a366a
merge
2018-12-23 18:24:04 +08:00
rewerma
0469d28c05
Merge pull request #28 from alibaba/master
...
merge
2018-12-23 18:20:43 +08:00
rewerma
d5f44dd76f
Merge branch 'master' into master
2018-12-23 18:20:33 +08:00
mcy
354d64069f
adapter增加同步异常重试
2018-12-23 18:16:47 +08:00
winger
3465866278
修复开启gtid时,同时开启tsdb后gtid 属性丢失的问题
2018-12-21 15:18:07 +08:00
agapple
840148fbf6
Merge pull request #1326 from rewerma/master
...
类型转换问题 fixed #1313
2018-12-21 15:10:25 +08:00
mcy
34b5f9c927
modify
2018-12-20 19:53:30 +08:00
mcy
75ee65f9e8
类型转换问题 fixed #1313
2018-12-20 19:45:57 +08:00
agapple
035ef26542
fixed issue #1306 , support MySqlOrderingExpr
2018-12-19 11:43:49 +08:00
agapple
4ef45b9a1d
Merge pull request #1310 from panjianping/master
...
添加 KafkaOffsetCanalConnector 使用示例
2018-12-18 16:51:50 +08:00
panjianping
990fa9498a
添加 KafkaOffsetCanalConnector 使用示例
2018-12-18 16:46:19 +08:00
agapple
276a2b988a
Merge pull request #1308 from panjianping/master
...
添加带kafka消息offset的Connector
2018-12-18 16:15:01 +08:00
panjianping
ef72cddfe8
添加带kafka消息offset的Connector
2018-12-18 11:54:41 +08:00
winger
d8d3246e30
Merge remote-tracking branch 'upstream/master'
2018-12-17 16:15:18 +08:00
winger
bba800eb96
修复开启gtid时,同时开启tsdb后gtid 属性丢失的问题
2018-12-17 16:14:55 +08:00
agapple
ff71bf515a
Merge pull request #1300 from gsfeng179/master
...
Update README.md
2018-12-17 12:52:58 +08:00
agapple
6ef48591a1
Merge pull request #1299 from rewerma/master
...
FlatMessage没有默认构造方法json反序列化的问题
2018-12-17 12:52:37 +08:00
gsfeng
a7526dbf4a
Update README.md
...
FAQ link error
2018-12-17 10:18:06 +08:00
mcy
51d94efc9c
dml类整理
2018-12-17 10:13:04 +08:00
mcy
833cc55e26
FlatMessage没有默认构造方法json反序列化的问题
...
Dml类增加isDdl属性
2018-12-17 09:47:09 +08:00
agapple
689366248d
Merge pull request #1289 from rewerma/master
...
rdb adapter增加mysql镜像db(schema)同步
2018-12-14 18:34:52 +08:00
mcy
3acdffb297
mirror schema 完成测试
2018-12-14 14:58:15 +08:00
mcy
fbf249580f
mirror db
2018-12-14 11:30:41 +08:00
agapple
d2e3e19831
fixed issue #1282 , NPE
2018-12-13 12:52:59 +08:00
agapple
0523b68c26
fixed parse error
2018-12-12 10:48:22 +08:00
agapple
995a33a645
Merge pull request #1278 from WithLin/master
...
Update AddressUtils.java
2018-12-12 10:44:05 +08:00
mcy
5c4b1f6e63
modify
2018-12-12 10:11:06 +08:00
XiaoFu
ba5865683f
Update AddressUtils.java
2018-12-12 10:03:49 +08:00
mcy
89a4943349
Merge branch 'master' into feature/rdb
2018-12-12 09:05:59 +08:00
agapple
35e0e882c1
fixed hash mode
2018-12-11 20:41:21 +08:00
agapple
0197482618
fixed partitionHash format
2018-12-11 20:17:08 +08:00
agapple
72bad4d54c
Merge pull request #1272 from rewerma/master
...
去除的多余的依赖
2018-12-11 17:03:07 +08:00
mcy
48de904ee1
去掉 #1266 中增加的 protocol 的多余的依赖
2018-12-11 14:43:13 +08:00
rewerma
f6a931d8c6
Merge pull request #27 from alibaba/master
...
merge
2018-12-11 14:15:33 +08:00
agapple
277a273ebc
fixed pull #1266 , optimizer code
2018-12-11 13:40:32 +08:00
agapple
bd5110b951
Merge pull request #1266 from rewerma/master
...
增加mq 分区规则配置正则表达式
2018-12-11 12:09:36 +08:00
machey
aeecf87490
去掉对before的判断,分区发送的表pk不能修改
2018-12-11 00:09:12 +08:00
machey
eac3f5ce5f
修改convert时设置pk
2018-12-10 23:54:07 +08:00
mcy
706ee88914
pattern表达式调整
...
pk缓存
2018-12-10 21:28:09 +08:00
agapple
7c63e81e01
fixed issue #1256 , rds alibaba_rds_row_id
2018-12-10 14:42:28 +08:00
mcy
99a1123e01
整理代码
2018-12-10 09:52:48 +08:00
mcy
24d898d87a
rdb 全schema同步
2018-12-10 09:25:40 +08:00
machey
5650b56bed
打印错误日志
2018-12-10 01:10:04 +08:00
machey
547cbf82c8
对原生message发送mq的分区支持
2018-12-10 01:03:18 +08:00
machey
03ee9c7ecf
根据主键Hash增加正则表达式支持,pk通配符指定自动获取支持
2018-12-10 00:09:49 +08:00
rewerma
ac738dae05
Merge pull request #26 from alibaba/master
...
merge
2018-12-09 22:06:29 +08:00
agapple
dda8081984
Merge pull request #1263 from tankilo/master
...
Linux启动脚本格式是DOS,需要转换成Unix格式
2018-12-08 13:26:52 +08:00
tankilo
f0fc37c43b
switch file format from DOS to UNIX
2018-12-07 14:54:45 +08:00
tankilo
5a99de1fa9
switch file format from DOS to UNIX
2018-12-07 14:54:06 +08:00
agapple
ce956c980d
add github template
2018-12-06 18:48:17 +08:00
agapple
c045dc244e
optimizer filter
2018-12-06 10:50:12 +08:00
agapple
1b11aa1d21
fixed issue #1220 , 解决一下no alive canal server重试过于频繁
2018-12-06 10:31:13 +08:00
rewerma
dac642f744
Merge pull request #25 from alibaba/master
...
merge
2018-12-03 17:55:32 +08:00
agapple
19e164b599
Merge pull request #1232 from rewerma/master
...
fixed #1229
2018-11-30 13:45:10 +08:00
mcy
339ecdd817
fixed #1229
2018-11-29 17:38:13 +08:00
rewerma
5fe7ae1613
Merge pull request #1228 from rewerma/master
...
rdb 关键字转译符过滤 fixed #1224
2018-11-29 15:42:19 +08:00
mcy
65f2695963
rdb 关键字转译符过滤
2018-11-29 15:39:08 +08:00
mcy
cf5e42442b
mysql jdbc依赖移到外部pom
2018-11-29 13:42:37 +08:00
agapple
e7b678d5e0
Merge pull request #1218 from rewerma/master
...
client打fat包排除其他包
2018-11-29 13:27:02 +08:00
mcy
f04447837c
client打fat包排除其他
2018-11-29 10:21:27 +08:00
rewerma
b7d2ad2e18
Merge pull request #1208 from rewerma/master
...
fixed #1201
2018-11-27 22:40:47 +08:00
machey
f1710f1c7f
fixed #1201
2018-11-27 22:39:49 +08:00
agapple
37094447b1
Merge pull request #1205 from rewerma/master
...
移除adapter pom中的parent fixed #1203
2018-11-27 19:41:42 +08:00
mcy
b97d377d83
移除adapter pom中的parent fixed #1203
2018-11-27 19:38:30 +08:00
agapple
46b6528273
fixed tablemeta check
2018-11-27 19:33:25 +08:00
agapple
6c3b3acde0
Merge pull request #1202 from DinoZhang/DinoZhang-patch-1
...
fix Datasource named ${DS_PROMETHEUS} was not found
2018-11-27 19:25:59 +08:00
DinoZhang
91b036a4fc
fix Datasource named ${DS_PROMETHEUS} was not found
2018-11-27 17:34:08 +08:00
DinoZhang
67cd0e5fca
Merge pull request #2 from alibaba/master
...
merge master
2018-11-27 17:10:57 +08:00
rewerma
9dfa5da7bc
Merge pull request #24 from alibaba/master
...
merge
2018-11-27 11:53:47 +08:00
agapple
9bda60bf89
fixed pom
2018-11-26 14:29:13 +08:00
agapple
9aaf20fb5e
[maven-release-plugin] prepare for next development iteration
2018-11-26 13:22:04 +08:00
agapple
8496ceaf15
[maven-release-plugin] prepare release canal-1.1.2
2018-11-26 13:21:51 +08:00
agapple
cf23e0ffea
fixed javadoc
2018-11-26 13:11:24 +08:00
agapple
4e9e3f5abe
fixed issue #1192 , NPE test
2018-11-25 21:17:34 +08:00
agapple
cbab3fb561
fixed issue #1168 , support filter with compareTableMetaDbAndMemory
2018-11-25 21:01:19 +08:00
agapple
f7bf4ac6ff
fixed log test
2018-11-25 18:33:34 +08:00
agapple
df4c66b9e2
Merge pull request #1193 from woshijay7788/feature_kafka_config
...
add max.request.size config
2018-11-25 11:55:51 +08:00
agapple
a6ee87281a
Merge pull request #1194 from guixincui/master
...
修改抽象引用
2018-11-25 11:55:00 +08:00
guixincui
90dab6831b
修改接口引用
2018-11-24 23:40:18 +08:00
gl
839d5415fc
add max.request.size config
2018-11-24 22:48:54 +08:00
agapple
29f03bf398
fixed batchSize calc
2018-11-24 15:34:39 +08:00
agapple
ec235f3efd
fixed rocketmq ak/sk
2018-11-23 09:56:55 +08:00
rewerma
3b25b3b342
Merge pull request #23 from alibaba/master
...
merge
2018-11-22 09:04:24 +08:00
agapple
aa89453bf6
fixed adapter
2018-11-21 22:49:22 +08:00
agapple
cc97f3b331
Merge pull request #1171 from rewerma/master
...
adapter 分批同步
2018-11-21 22:09:33 +08:00
agapple
89ec3037d4
Merge pull request #1173 from RickJou/master
...
等号两边都有空格
2018-11-21 21:48:15 +08:00
mcy
e711f1a091
rdb 并行提交
2018-11-21 16:57:02 +08:00
Alan
ad18e0335d
等号两边都有空格
...
格式保持一致,看起来更像大厂出品 ^_^
2018-11-21 16:31:46 +08:00
mcy
67cc73b8e2
adapter 配置修改
2018-11-21 14:26:19 +08:00
agapple
638952fad1
fixed binlog seek & aliyun ak/sk
2018-11-21 13:51:34 +08:00
mcy
56ec66f90e
adapter 分批同步
2018-11-21 13:46:30 +08:00
agapple
c0bbe530f1
Merge pull request #1169 from ymwneu/supportRocketMQ
...
[ISSUE#1109]Support aliyun RocketMQ
2018-11-21 12:51:31 +08:00
maowei.ymw
4bfc476e08
Modify rocketMQ related pom
2018-11-21 10:44:58 +08:00
rewerma
5d71d50d4e
Merge pull request #22 from alibaba/master
...
merge
2018-11-20 20:08:11 +08:00
agapple
26700f3005
fixed batch sync dml
2018-11-20 19:01:07 +08:00
agapple
a7be9c75f9
fixed mysql rotate checksum
2018-11-20 18:29:01 +08:00
agapple
b6f1e0d13c
fixed rocketmq ack npe
2018-11-20 17:14:29 +08:00
maowei.ymw
50630cc934
Support client connect rocketmq in aliyun
2018-11-19 14:33:59 +08:00
agapple
43db5bec97
Merge pull request #1155 from rewerma/master
...
es readme.md
2018-11-18 12:51:29 +08:00
mcy
affd598470
es readme.md
2018-11-17 21:18:48 +08:00
agapple
178bea07a8
Merge pull request #1154 from rewerma/master
...
adapter 配置修改动态加载
2018-11-17 15:29:00 +08:00
mcy
fcdf95b5ec
rdb 批量提交超时提交
2018-11-17 04:37:46 +08:00
mcy
991418ce6e
修改rdb批量提交分批的问题
2018-11-16 22:53:10 +08:00
mcy
d34bee3359
adapter 配置修改动态加载
2018-11-16 18:07:32 +08:00
agapple
0a3c1645e8
Merge pull request #1153 from rewerma/master
...
rdb 批量提交优化
2018-11-16 14:07:23 +08:00
mcy
9dc4d78b3b
fix
2018-11-16 13:24:36 +08:00
mcy
bc056288d4
rdb 批量提交优化
2018-11-16 13:12:50 +08:00
agapple
8aea31232b
Merge pull request #1151 from rewerma/master
...
将oracle mssql pgsql 的jdbc打包进lib
2018-11-16 10:16:26 +08:00
machey
fc6c871382
Merge branch 'master' into feature/mcy
...
# Conflicts:
# client-adapter/rdb/pom.xml
2018-11-16 00:06:56 +08:00
machey
14c0e4535a
将oracle mssql pgsql 的jdbc打包进lib
2018-11-15 23:59:16 +08:00
mcy
7ee7ba0e05
rdb 批量提交
2018-11-15 22:47:08 +08:00
agapple
7992b883d2
fixed binlog checksum
2018-11-15 19:40:23 +08:00
agapple
5bc0c3f06f
Merge pull request #1147 from rewerma/master
...
rdb 批量并行提交
2018-11-15 19:28:29 +08:00
mcy
b457ecd387
adapter 主配置application.yml动态加载
2018-11-15 17:09:53 +08:00
mcy
997646b2db
指定是否按主键hash并行同步, 否则按表名hash表间并行同步
2018-11-15 10:39:34 +08:00
mcy
915849b83a
预留sync(MappingConfig config, List<Dml> dmlList)方法
...
pk hash以old pk值为准若存在
2018-11-14 20:26:38 +08:00
agapple
129118b483
Merge pull request #1149 from spccold/master
...
filter views when dumpTableMeta
2018-11-14 19:50:41 +08:00
wuwo
aa68408c53
filter views when dumpTableMeta
2018-11-14 19:21:34 +08:00
mcy
d396a0b65c
rdb 批量提交
2018-11-14 18:21:50 +08:00
mcy
827b872cf8
rdb 批量并行提交
2018-11-14 18:05:55 +08:00
agapple
6f3cae5ddf
Merge pull request #1143 from rewerma/master
...
配置整理
2018-11-14 16:54:29 +08:00
mcy
31bf92ec8e
配置整理
2018-11-14 11:49:22 +08:00
mcy
68d8aee6c3
配置整理
2018-11-14 11:32:01 +08:00
mcy
c376f0afd2
配置中增加 canal.mq.acks canal.mq.compressionType
2018-11-14 11:14:32 +08:00
mcy
60e5554125
修改bootstrapServers为mqServers
2018-11-14 11:00:55 +08:00
mcy
241c43a894
Merge remote-tracking branch 'origin/master'
...
# Conflicts:
# client-adapter/common/src/main/java/com/alibaba/otter/canal/client/adapter/support/ExtensionLoader.java
2018-11-14 10:50:11 +08:00
rewerma
fecc112196
Merge pull request #21 from alibaba/master
...
merge
2018-11-14 10:48:04 +08:00
agapple
dd04577994
Merge pull request #1142 from spccold/master
...
let tsdbSnapshotInterval config work correctly
2018-11-13 22:04:16 +08:00
agapple
51a299259b
Merge pull request #1141 from Renkai/compression_type
...
Kafka增加参数acks和compressionType
2018-11-13 22:03:00 +08:00
wuwo
0a0a39880c
Merge remote-tracking branch 'upstream/master'
2018-11-13 20:54:45 +08:00
wuwo
5ad9cf3f16
let tsdbSnapshotInterval config work correctly
2018-11-13 20:54:36 +08:00
mcy
d29fe5b04e
去掉调试代码
2018-11-13 20:01:20 +08:00
agapple
20062d861d
fixed test code
2018-11-13 19:59:18 +08:00
agapple
73de8b32a9
Merge pull request #1140 from rewerma/master
...
adapter plugin
2018-11-13 19:51:36 +08:00
Renkai
8af1301062
Kafka增加参数acks和compressionType
2018-11-13 18:29:25 +08:00
mcy
8c3ade2d50
外部adapter plugin文件夹
2018-11-13 17:40:12 +08:00
rewerma
752a3cd66a
Merge pull request #20 from alibaba/master
...
merge
2018-11-13 14:13:41 +08:00
agapple
154ba422f2
fixed plugin
2018-11-13 14:10:48 +08:00
agapple
03a9522191
fixed event
2018-11-13 13:41:19 +08:00
agapple
c4947cad3c
Merge pull request #1133 from spccold/master
...
fix MemoryTableMeta#processTableElement bug
2018-11-13 11:34:15 +08:00
wuwo
3f8cdafea3
fix MemoryTableMeta#processTableElement bug
2018-11-13 11:14:37 +08:00
agapple
fcaf8e88f8
Merge pull request #1132 from rewerma/master
...
rdb adapter整理
2018-11-13 09:18:27 +08:00
mcy
e7ab25f819
增加rdb adapter说明
2018-11-12 18:26:34 +08:00
mcy
b45a27e231
db同步代码整理
2018-11-12 18:01:52 +08:00
mcy
2e5b7b89af
简化adapter配置
2018-11-12 17:30:40 +08:00
mcy
66912d3d05
rdb etl count destination 接口适配
...
es hbase 多源适配
2018-11-12 15:07:46 +08:00
agapple
ec1ac6d11c
Merge pull request #1131 from rewerma/master
...
rdb同步适配多数据源
2018-11-12 10:25:37 +08:00
machey
7cca8857ff
README.md 修改
2018-11-11 19:56:14 +08:00
machey
e7086415f8
rdb专用的的ClassExtensionLoader,默认canal client logger example配置
2018-11-11 19:44:30 +08:00
machey
4a27d81da1
Merge branch 'master' of https://github.com/rewerma/canal
2018-11-11 18:34:46 +08:00
rewerma
739425e99c
Merge pull request #19 from alibaba/master
...
merge
2018-11-11 18:33:46 +08:00
agapple
cc1574d913
fixed adapter
2018-11-11 01:15:02 +08:00
machey
d7ab6e2dc1
rdb同步适配多数据源
2018-11-10 23:55:09 +08:00
agapple
808bedf984
Merge pull request #1128 from spccold/master
...
fixed DatabaseTableMeta#compareTableMeta
2018-11-10 12:17:09 +08:00
agapple
357eb885b2
Merge pull request #1127 from rewerma/master
...
canal server端 MQ 配置修改
2018-11-10 12:16:31 +08:00
wuwo
417e04f655
fixed DatabaseTableMeta#compareTableMeta
2018-11-09 19:23:03 +08:00
mcy
2d41bb9960
修改mq配置针对destination级别重启
2018-11-09 18:19:51 +08:00
mcy
7d7c82ce91
修改mq配置针对destination级别重启
2018-11-09 18:12:04 +08:00
mcy
0c3f7a806e
代码整理
2018-11-09 17:06:42 +08:00
mcy
2a38bca34b
代码整理
2018-11-09 16:52:34 +08:00
mcy
c5bd42bbf1
canal server端 MQ 配置修改
...
MQ配置可动态加载
2018-11-09 16:39:52 +08:00
agapple
8c1f15a49e
Merge pull request #1126 from rewerma/master
...
关系型数据同步adapter, 支持 mysql oracle postgresql sqlserver
2018-11-09 15:26:07 +08:00
agapple
f9778a0aff
fixed issue #1087 , support kafka docker check
2018-11-09 13:58:39 +08:00
mcy
2ac84b4320
关系型数据同步adapter, 支持 mysql oracle postgresql sqlserver
2018-11-08 19:34:15 +08:00
jiangahng.loujh
0677443ccf
fixed issue #1100 , fix type compare
2018-11-08 13:57:12 +08:00
jiangahng.loujh
2c1f3e649a
fixed issue #1107 , more info message
2018-11-08 13:50:23 +08:00
agapple
4faf5428b1
Merge pull request #1120 from rewerma/master
...
flagMessage json 序列化无null值的bug
2018-11-08 13:39:09 +08:00
mcy
b71472661b
Merge branch 'master' into feature/mcy
2018-11-08 11:23:47 +08:00
mcy
6fa111866f
flagMessage json 序列化无null值的bug
2018-11-08 11:22:34 +08:00
mcy
f7ea8df89e
rdb新增同步测试完成
2018-11-08 11:19:50 +08:00
agapple
041225c3f2
Merge pull request #1118 from littleneko/patch-1
...
fix: buildLastTransactionPosition 的 for 循环少了 =0
2018-11-07 21:58:30 +08:00
agapple
a8d708ea1b
Merge pull request #1116 from spccold/master
...
a little improvement for DatabaseTableMeta
2018-11-07 21:55:54 +08:00
mcy
5ae7112192
init rdb sync
2018-11-07 21:01:50 +08:00
littleneko
2278340c7b
fix: buildLastTransactionPosition 的 for 循环少了 =0
2018-11-07 20:24:38 +08:00
wuwo
87abaee8a7
a little improvement for DatabaseTableMeta
2018-11-07 15:50:33 +08:00
agapple
8f2e2b9ccd
Merge pull request #1108 from spccold/master
...
skip tsdb snapshot apply if has not receive new ddl change from last …
2018-11-07 15:01:43 +08:00
agapple
d2ecb0aad9
Merge pull request #1112 from rewerma/master
...
client 排除jsr305不打进fat jar
2018-11-07 15:00:40 +08:00
mcy
1126d26574
Merge branch 'master' into feature/mcy
2018-11-07 11:40:06 +08:00
mcy
b71e299161
kafka单个partition的发送未改为同步发送的bug fix
2018-11-07 11:37:16 +08:00
mcy
572ea9f27a
Merge branch 'master' into feature/mcy
2018-11-07 09:34:00 +08:00
mcy
bc298bedd5
支持hbase rowkey指定数字长度
2018-11-07 09:32:52 +08:00
mcy
202557630c
调整etl锁的粒度
2018-11-07 09:05:47 +08:00
machey
c27d5fa162
ETL整个destination,同步开关无效的问题
2018-11-07 02:04:08 +08:00
machey
3090557eeb
client 排除jsr305不打进fat jar
2018-11-06 23:16:11 +08:00
machey
6de9f7efa7
修改 adapter release 打包名称
2018-11-06 22:49:34 +08:00
wuwo
f2b8d000f7
skip tsdb snapshot apply if has not receive new ddl change from last snapshot time
2018-11-06 16:59:44 +08:00
agapple
8ee546d34d
Merge pull request #1106 from rewerma/master
...
修改adapter打包,启动方式
2018-11-06 16:24:31 +08:00
mcy
5b94c69d10
修改adapter打包,启动方式
2018-11-06 14:52:17 +08:00
mcy
8ae192f0a9
adapter canal-client 版本
2018-11-06 09:56:16 +08:00
rewerma
2e1a1c31e6
Merge pull request #18 from alibaba/master
...
merge
2018-11-06 09:50:11 +08:00
agapple
238da873b2
Merge pull request #1104 from jiacheo/master
...
修复rocketmq&kafka 发送消息失败时回滚后继续提交的问题
2018-11-05 23:08:34 +08:00
jiacheo
edb5f294ef
fix:rollback之后继续commit,会产生 CanalServerException: ack error , clientId:1001 batchId:12 is not exist , please check 的错误。
2018-11-05 22:00:56 +08:00
agapple
5a76e2aa58
Merge pull request #1103 from wingerx/master
...
增加alter rename 的ddl 类型为rename
2018-11-05 19:50:20 +08:00
winger
1e20cac0da
Merge remote-tracking branch 'upstream/master'
2018-11-05 18:39:47 +08:00
winger
d8e411462e
增加alter rename 的类型为rename
2018-11-05 18:38:44 +08:00
agapple
59e65ed4a6
Merge pull request #1099 from spccold/master
...
destory TableMetaTSDB when stop EventParser
2018-11-05 17:39:50 +08:00
agapple
4319b5e888
Merge pull request #1098 from rewerma/master
...
ES Adapter 支持
2018-11-05 17:32:26 +08:00
mcy
0d9695c3a5
增加对array和object类型的支持
2018-11-05 17:29:11 +08:00
七锋
359aa1a074
fixed compiler failed
2018-11-05 16:53:15 +08:00
wuwo
e608f09b53
improve DatabaseTableMeta
2018-11-05 16:37:42 +08:00
wuwo
beed10901d
destory TableMetaTSDB when stop EventParser
2018-11-05 16:22:15 +08:00
mcy
dab6fa5aa1
Merge branch 'master' of https://github.com/rewerma/canal
2018-11-05 15:31:41 +08:00
rewerma
30d20f824b
Merge pull request #17 from alibaba/master
...
merge
2018-11-05 15:31:02 +08:00
mcy
80cf533b05
整理注释
2018-11-05 15:24:32 +08:00
七锋
6ff57f53f8
fixed issue #1070 , support mysql8.0.13
2018-11-05 15:06:40 +08:00
mcy
650446de5b
etl实现
2018-11-05 13:36:35 +08:00
mcy
347601b9fe
同步测试类
2018-11-05 11:40:27 +08:00
mcy
5c8a5998d9
修改外键
2018-11-05 10:06:45 +08:00
mcy
391e040c6a
删除测试完成
...
后续: 修改 删除外键的情况, 修改主键的情况适配
2018-11-02 17:19:52 +08:00
七锋
8597d9e926
fixed more info
2018-11-02 12:51:36 +08:00
agapple
a895ce666e
Merge pull request #1090 from jiacheo/master
...
CanalMessageDeserializer.deserializer 方法和FlatMessage.messageConverter 配合的问题
2018-11-02 11:10:22 +08:00
mcy
9d113dbc13
Merge branch 'master' into feature/mcy
...
# Conflicts:
# client-adapter/launcher/src/main/resources/application-sample.yml
# client-adapter/launcher/src/main/resources/application.yml
2018-11-02 11:08:57 +08:00
mcy
5cc2f8f9f7
增加file的path读取
2018-11-02 11:07:41 +08:00
mcy
5b9ada1f8c
修改测试完成
2018-11-02 09:51:30 +08:00
jiacheo
369059fa39
Merge pull request #1 from jiacheo/fix-lazyParseEntry-raw-wrong-value
...
Update CanalMessageDeserializer.java
2018-11-02 01:53:08 +08:00
jiacheo
9473f4e8fd
Update CanalMessageDeserializer.java
...
fix lazyParseEntry 'raw' wrong value.
2018-11-02 01:48:17 +08:00
rewerma
685053599f
Merge pull request #1086 from rewerma/master
...
release包不打进application.yml
2018-11-01 23:44:41 +08:00
machey
a9727cf267
release包不打进application.yml
2018-11-01 23:43:53 +08:00
agapple
bc399ba9f9
Merge pull request #1069 from spccold/master
...
pass useDruidDdlFilter parameter to LogEventConvert
2018-11-01 22:58:01 +08:00
mcy
81f403a9f2
更新完成
2018-11-01 21:07:45 +08:00
wuwo
332f759f96
filter dml before apply to tsdb
2018-11-01 17:38:18 +08:00
wuwo
5d5aafb7cd
Merge remote-tracking branch 'upstream/master'
2018-11-01 17:28:29 +08:00
mcy
f42f7cfe72
Merge branch 'master' into feature/mcy
...
# Conflicts:
# client-adapter/launcher/src/main/resources/application.yml
2018-11-01 16:39:56 +08:00
mcy
96b9484f70
modify
2018-11-01 16:37:47 +08:00
七锋
3bb408194d
fixed issue #1081 , support mariadb rotate_event support checksum
2018-11-01 16:03:40 +08:00
mcy
865ba94605
application.yml配置打包设置默认模板
2018-11-01 15:22:14 +08:00
mcy
bb883cd228
Merge branch 'master' into feature/mcy
2018-11-01 14:53:51 +08:00
rewerma
d3e1ddd234
Merge pull request #1084 from rewerma/master
...
fix #1083
2018-11-01 14:47:33 +08:00
mcy
b9c4884af1
fix #1083
2018-11-01 14:46:29 +08:00
mcy
a6b16eedfa
modify
2018-11-01 14:43:59 +08:00
mcy
9d04a82c42
新增完成
2018-11-01 14:32:11 +08:00
mcy
c9ad18894d
从表插入, 主表为简单字段
2018-11-01 11:33:12 +08:00
mcy
b2b44555ca
从表插入, 主表为简单字段
2018-11-01 11:07:35 +08:00
mcy
14e094b522
modify
2018-10-31 18:47:16 +08:00
agapple
0dea4b7944
Merge pull request #1079 from rewerma/master
...
application.yml不打包进jar
2018-10-31 17:34:33 +08:00
mcy
94a3cfa9de
Merge branch 'master' into feature/mcy
2018-10-31 17:18:57 +08:00
mcy
ed1feb9502
application.yml不打包进jar, 解决jar中的application.yml和config中的会合并bug
2018-10-31 16:58:50 +08:00
mcy
a4856b9a73
modify
2018-10-31 16:55:48 +08:00
七锋
ff3ccde62a
fixed rds binlog dump
2018-10-31 14:25:54 +08:00
mcy
2a2977eca7
主表带函数新增
2018-10-31 14:00:06 +08:00
七锋
1d9e2ccedd
fixed issue #1076 , support rds binlog expired
2018-10-31 12:51:02 +08:00
七锋
dd8243a56d
fixed issue #1075 , support message transactor filter
2018-10-30 23:48:05 +08:00
mcy
2c9acb655d
单表新增
2018-10-30 19:52:05 +08:00
mcy
e1191b665e
es配置加载
2018-10-30 15:57:00 +08:00
mcy
e4e23c9ecd
增加adapter相关参数: retry timeout batchSize
2018-10-30 14:13:51 +08:00
wuwo
4ce2b94241
rollback tsdb change
2018-10-30 11:49:49 +08:00
mcy
11ac253c46
adapter pom整理
2018-10-30 10:12:19 +08:00
mcy
1d2e85672c
elasticsearch适配器
2018-10-30 09:49:04 +08:00
mcy
82b8b56aa3
partition默认为空
2018-10-30 09:10:49 +08:00
mcy
4e18d7800a
拼写错误
2018-10-30 09:08:34 +08:00
rewerma
7efd067bd5
Merge pull request #16 from alibaba/master
...
merge
2018-10-29 20:14:36 +08:00
wuwo
4c7129115c
a little improve about tsdb
2018-10-29 17:49:34 +08:00
wuwo
0f14ed926b
pass useDruidDdlFilter parameter to LogEventConvert
2018-10-29 17:32:10 +08:00
七锋
be5f1546ca
fixed issue #1063 , rocketmq bugfix
2018-10-29 16:56:29 +08:00
agapple
f3160bf6cb
Merge pull request #1065 from f-zhao/zhaofeng-branch
...
fix: fix NPE, 使用CanalServerWithManager时,开启GTID模式下,不传入masterPosition的情…
2018-10-29 16:42:46 +08:00
赵峰
fa79db65b7
fix: fix NPE, 使用CanalServerWithManager时,开启GTID模式下,不传入masterPosition的情况下,会产生NPE
2018-10-29 16:18:12 +08:00
七锋
d134aa0c20
fixed adjust default value
2018-10-29 15:59:32 +08:00
七锋
b9f40f326f
[maven-release-plugin] prepare for next development iteration
2018-10-29 14:57:39 +08:00
七锋
774aeeea68
[maven-release-plugin] prepare release canal-1.1.1
2018-10-29 14:57:25 +08:00
七锋
f28efce11e
fixed javadoc for release
2018-10-29 14:54:17 +08:00
七锋
d03e7e2b15
fixed canal_version release
2018-10-29 13:49:24 +08:00
七锋
56ed158814
fixed issue #850 , support alter lock/algorithm
2018-10-29 12:46:20 +08:00
rewerma
166a9a7f8f
Merge pull request #1059 from rewerma/master
...
CanalConnector接口去掉stopRunning方法
2018-10-29 01:42:30 +08:00
mcy
b131e8cfa4
CanalConnector接口去掉stopRunning接口
2018-10-29 01:40:34 +08:00
mcy
2e1d0e36c5
group 线程池在父类初始化
2018-10-29 01:05:12 +08:00
agapple
ddcf619deb
Update README.md
2018-10-28 23:39:11 +08:00
rewerma
8f1b66ab5a
Merge pull request #1057 from rewerma/master
...
kafka canal-adapter 分布式开关的bug
2018-10-28 22:36:56 +08:00
mcy
167858cd95
解决分布式同步开关关闭同步状态下,
...
重启 kafka canal-adapter后在开启同步,丢失数据的bug
2018-10-28 22:35:32 +08:00
rewerma
04e56fb94c
Merge pull request #1056 from rewerma/master
...
group 线程池没有初始化的bug
2018-10-28 21:50:53 +08:00
mcy
00fce30072
group 线程池没有初始化的bug
2018-10-28 21:50:19 +08:00
rewerma
423392a18a
Merge pull request #1055 from rewerma/master
...
代码整理
2018-10-28 21:33:46 +08:00
mcy
cdb34571ab
adapter readme 修改
2018-10-28 21:31:57 +08:00
mcy
3b4d28eec3
测试修改
2018-10-28 21:30:54 +08:00
mcy
297122f47f
Merge branch 'master' of https://github.com/rewerma/canal
2018-10-28 21:19:53 +08:00
rewerma
f9ff05f16c
Merge pull request #15 from alibaba/master
...
merge
2018-10-28 21:17:04 +08:00
七锋
071545987b
fixed mq config
2018-10-28 21:15:57 +08:00
七锋
c36a51b8e3
fixed client-adpater logger test
2018-10-28 20:29:00 +08:00
七锋
232bbaf6d4
fixed group name
2018-10-28 19:58:07 +08:00
七锋
a0b38a9cac
fixed MQConnector
2018-10-28 19:52:26 +08:00
agapple
d76367584c
Merge pull request #1054 from duhengforever/canal_rocketmq_flatmessage
...
[ISSUE1027]Add flat message support to rocketmq
2018-10-28 17:37:38 +08:00
duhengforever
86fd77f9c4
Resolve conflict
2018-10-28 17:00:33 +08:00
duhengforever
ebaf78f5aa
Resolve conflict with master branch
2018-10-28 16:18:13 +08:00
duhengforever
b484593869
Add flat message support to rocketmq
2018-10-28 16:09:31 +08:00
mcy
a7bf6258f7
hbase类型转换工具类整理
2018-10-27 22:23:41 +08:00
rewerma
2c6bd3ee1b
Merge pull request #1050 from rewerma/master
...
修改hbase配置项名
2018-10-27 20:05:41 +08:00
mcy
87ac3daecc
修改hbase配置项名
2018-10-27 20:03:26 +08:00
七锋
fd7b9d766a
fixed snapshot expire
2018-10-27 00:47:50 +08:00
七锋
f822761ab2
fixed issue #1047 , support snapshot expire
2018-10-26 23:46:41 +08:00
七锋
1e2cf9d476
fixed bit(8) with value 255
2018-10-26 21:51:19 +08:00
七锋
2d930894ff
fixed issue #1046 , tinyint(1) unsigned with value 255
2018-10-26 21:50:12 +08:00
rewerma
30b7de7233
Merge pull request #1045 from rewerma/master
...
修改打包配置
2018-10-26 15:57:07 +08:00
mcy
0d22dbc982
修改打包配置
2018-10-26 15:56:05 +08:00
rewerma
8446e17703
Merge pull request #14 from alibaba/master
...
merge
2018-10-26 14:59:39 +08:00
七锋
fb936f896e
fixed client-launcher deploy
2018-10-26 14:57:52 +08:00
mcy
0d0fcbbc0b
修改HBase适配器配置
2018-10-26 14:03:29 +08:00
rewerma
5cfbc6b91d
Update README.md
2018-10-26 13:36:59 +08:00
rewerma
3b1f6ce4fb
Update README.md
2018-10-26 13:25:40 +08:00
rewerma
fd3927ce3e
Merge pull request #1042 from rewerma/master
...
canal adapter readme.md
2018-10-26 13:24:36 +08:00
mcy
bbfd4b4996
canal-adapter readme.md
2018-10-26 13:23:22 +08:00
mcy
848cbe11dd
代码整理
2018-10-26 10:33:16 +08:00
rewerma
f7185a618b
Merge pull request #1039 from rewerma/master
...
规范注释
2018-10-25 21:24:30 +08:00
mcy
d70dc8b88c
规范注释
2018-10-25 21:21:06 +08:00
agapple
b5f5d3f0f0
Merge pull request #1037 from rewerma/master
...
完善adapter-launcher及hbase-adaper相关功能
2018-10-25 20:19:48 +08:00
mcy
ddfc2464f3
etl 增加同步锁
2018-10-25 17:43:11 +08:00
mcy
c3402a97f3
etl 增加同步锁
2018-10-25 17:34:15 +08:00
mcy
6ee6b3c398
同步分布式开关
2018-10-25 16:43:33 +08:00
mcy
42a4abe4c7
HBase etl锁定同步等待
2018-10-25 14:24:33 +08:00
mcy
0f1334c92c
加入同步开关
2018-10-25 13:52:52 +08:00
七锋
346d091d00
fixed issue #1032 , support raw config
2018-10-25 13:11:34 +08:00
mcy
27dba9ec1b
HBase根据datasourceKey导入
2018-10-25 10:52:55 +08:00
mcy
8dbf63e436
增加adapter assembly打包
2018-10-25 10:05:05 +08:00
mcy
30a11c75cb
HBase的etl初步完成
2018-10-24 20:47:25 +08:00
mcy
49caff5759
HBase的etl初步完成
2018-10-24 19:12:16 +08:00
mcy
0a7251add0
HBase的etl初步完成
2018-10-24 18:30:42 +08:00
七锋
b5dac60cbb
fixed cliet-adapter artifactId
2018-10-24 17:00:56 +08:00
七锋
9270834631
fixed rds ak/sk config for manager
2018-10-24 16:46:26 +08:00
七锋
575dd59c78
fixed mysql set(8 bit) type parse
2018-10-24 16:25:28 +08:00
mcy
15e79c1400
调整Hbase适配
2018-10-24 15:40:48 +08:00
七锋
c75c248086
fixed issue #1019 , support canal embedded with Entry
2018-10-24 13:45:58 +08:00
rewerma
741f6310b3
Merge pull request #13 from alibaba/master
...
merge
2018-10-24 13:25:15 +08:00
rewerma
2202ec451a
Merge pull request #1028 from ttting/master
...
Fix Kafka FlatMessage Model Null Value set to ""
2018-10-24 12:58:00 +08:00
rewerma
1830458b6b
Merge pull request #1031 from rewerma/master
...
新增adapter-launcher工程
2018-10-24 12:56:55 +08:00
mcy
1b88430f71
去掉client-launcher, 移入client-adapter中重命名为example, 调整其他相关模块结构
2018-10-24 12:55:42 +08:00
mcy
bbb4c4347e
修改adapter-launcher模块名为launcher
2018-10-24 12:44:19 +08:00
mcy
0ee46ad70e
jar包依赖调整
2018-10-24 11:49:58 +08:00
mcy
243e129710
jar包依赖调整
2018-10-24 11:43:36 +08:00
mcy
a91f204682
新增adapter-launcher springboot工程
2018-10-24 11:29:28 +08:00
titeng.jiang
5bc5eec85e
Fix Kafka FlatMessage Model Null Value set to ""
2018-10-24 10:02:50 +08:00
agapple
80d3781d81
Update README.md
2018-10-23 23:27:42 +08:00
agapple
b1e2ab4448
Update README.md
2018-10-23 23:25:05 +08:00
rewerma
3e49e33f9f
Merge pull request #12 from alibaba/master
...
merge
2018-10-23 15:38:45 +08:00
agapple
986840b6bf
Merge pull request #1014 from wingerx/master
...
修复通过`show master status`获取到多个GTID 时,回车符导致UUID 解析失败的bug
2018-10-19 12:57:47 +08:00
winger
61aea888f6
Merge remote-tracking branch 'upstream/master'
2018-10-19 10:30:16 +08:00
winger
c16037122b
修复通过show master status获取到多个GTID 时,回车符导致UUID 解析失败的bug
2018-10-19 10:27:50 +08:00
七锋
a823b909ad
upgrade spring version 3.2.18
2018-10-17 18:35:32 +08:00
七锋
5d55c7ac00
fixed fastsql upgrade
2018-10-17 15:43:26 +08:00
rewerma
75f380252e
Merge pull request #11 from alibaba/master
...
merge
2018-10-17 00:48:03 +08:00
七锋
5eb67990ca
fixed es reset
2018-10-16 16:57:57 +08:00
七锋
017fe87e4b
fixed issue #928 , support Dml.executeTime
2018-10-16 16:55:30 +08:00
七锋
fc050c3ce9
fixed issue #980 , support TSDB dup column
2018-10-16 16:45:25 +08:00
七锋
b893aafae7
fixed issue #1001 , support docker restart
2018-10-16 13:33:45 +08:00
七锋
9c24b26d02
fixed gtid
2018-10-16 13:29:53 +08:00
agapple
22d1fc98ee
Merge pull request #1006 from WithLin/patch-2
...
support golang canal client address link
2018-10-16 13:12:43 +08:00
agapple
d88f204a15
Merge pull request #1002 from wallellen/fix-release-threadpool
...
1. AbstractEventParser 中应该对multiStageCoprocess每次在while最后进行stop而不是rese…
2018-10-16 11:36:28 +08:00
XiaoFu
5d0f79932a
Update README.md
2018-10-15 18:36:08 +08:00
wallellen
7c44e5933d
1. AbstractEventParser 中应该对multiStageCoprocess每次在while最后进行stop而不是reset, reset会在mysqlMultiStageCoprocessor中重新创建两个线程池, 如果在dump出错的情况下, 会无限多的创建multiStageCoprocess而且不释放
...
2. MySqlMultiStageComprocessor中需要判断是否已经shutdown, 实际情况中存在shutdown为true而terminal一直为false的情况
2018-10-12 18:27:32 +08:00
agapple
4d36c60738
Merge pull request #990 from shicmV5/master
...
增加 目标数据库密码加密解密,采用druid方式进行加密解密,并设置canal.instance.enableDruid=true时,请使…
2018-10-09 22:15:46 +08:00
shichengming
53c2a02124
增加 目标数据库密码加密解密,采用druid方式进行加密解密,并设置canal.instance.enableDruid=true时,请使用druid加密数据库密码。false时,就是使用明文密码。
2018-10-09 16:49:33 +08:00
agapple
1701a4c97c
Merge pull request #981 from rewerma/master
...
client模块中rocketmq-client包scope provide,外部使用单独依赖
2018-10-08 10:29:46 +08:00
mcy
e4b6385dcc
调整kafka同步发送和消费,确保消息不丢失
2018-10-03 16:32:08 +08:00
mcy
2e92ec3e4d
client模块中rocketmq-client包scope provide,外部使用单独依赖
2018-10-03 12:27:56 +08:00
rewerma
d20485027f
Merge pull request #10 from alibaba/master
...
merge
2018-10-03 12:09:49 +08:00
七锋
eb2a83b975
fixed test
2018-09-30 11:33:48 +08:00
七锋
9344ed121f
format & import
2018-09-30 10:52:41 +08:00
agapple
c3327e567e
Merge pull request #973 from duhengforever/develop_rocketmq
...
[ISSUE 800]提供RocketMQ原生接入canal
2018-09-30 10:28:37 +08:00
duhengforever
3ed8987779
Remove useless log print
2018-09-30 09:49:13 +08:00
duhengforever
fa8588f766
Modify canal-client config and polish consumer implementation
2018-09-30 09:40:05 +08:00
rewerma
fa8ffb8e66
Merge pull request #9 from alibaba/master
...
merge
2018-09-29 15:52:23 +08:00
agapple
9da8f9cc5a
Merge pull request #969 from WithLin/patch-1
...
Fix link error
2018-09-29 13:50:55 +08:00
duhengforever
af03f07cc7
Modify default config
2018-09-27 19:39:46 +08:00
duhengforever
5ae16b1c7c
Merge canal repo master
2018-09-27 17:09:00 +08:00
duhengforever
a37a7ff142
Add RocketMQ example and polish mq abstract class
2018-09-27 10:34:17 +08:00
agapple
ff592758cf
Merge pull request #970 from wingerx/master
...
fix bug #968
2018-09-26 13:13:27 +08:00
winger
b04446d24d
Merge remote-tracking branch 'upstream/master'
2018-09-25 18:46:39 +08:00
winger
40f8c931c7
fix bug #968 : 对于workpool与BatchEventProcessor需要手动调用halt(),否则会导致其使用的工作线程(池)无法正常关闭(parserExecutor/stageExecutor.shutdownNow()无效)
2018-09-25 18:46:10 +08:00
XiaoFu
a22517adc2
Fix link error
2018-09-25 17:53:54 +08:00
duhengforever
821f3eced5
Add mq adapter
...
Signed-off-by: duhengforever <duhengforever@gmail.com >
2018-09-25 10:22:31 +08:00
七锋
00ec70d425
fixed readme
2018-09-21 15:45:52 +08:00
七锋
9d48d23787
fixed readme
2018-09-21 15:44:03 +08:00
七锋
9535e82da6
fixed readme
2018-09-21 15:40:18 +08:00
agapple
fd80f953e9
Update README.md
2018-09-21 15:30:35 +08:00
agapple
05718a9f20
Merge pull request #958 from rewerma/master
...
kafka生产端增加按pk hash到对应partition功能
2018-09-21 15:10:01 +08:00
mcy
19b7f730b6
整理代码
2018-09-20 18:06:47 +08:00
mcy
4f2b4cea53
整理代码
2018-09-20 17:25:32 +08:00
mcy
e566160f1e
整理代码
2018-09-20 17:24:32 +08:00
mcy
74890050d0
kafka生产端增加按pk hash到对应partition功能
2018-09-20 16:48:14 +08:00
mcy
0cda90cdea
默认将数据发现kafka的partition 0,避免多分区的数据一致性问题
...
后续将支持通过id hash分发数据
2018-09-20 16:17:38 +08:00
rewerma
1a11153cd2
Merge pull request #8 from alibaba/master
...
merge
2018-09-20 16:03:43 +08:00
duhengforever
d5aa324ce4
Add RocketMQ canal connector
2018-09-20 15:48:52 +08:00
七锋
09df602f3b
support filterTransactionEntry
2018-09-20 11:30:10 +08:00
agapple
b026c44ea8
Merge pull request #953 from DaiZZZZZ/master
...
单词拼写修正
2018-09-20 10:15:23 +08:00
zhikuodai
19f765df77
单词拼写修正
2018-09-19 15:16:38 +08:00
rewerma
4e1675033a
Merge pull request #7 from alibaba/master
...
merge
2018-09-18 10:18:32 +08:00
rewerma
e9439125bd
Merge branch 'master' into master
2018-09-18 10:18:22 +08:00
agapple
a11f9e4b34
Merge pull request #949 from WithLin/master
...
Fix simpleCanalConnector bug
2018-09-18 10:06:44 +08:00
agapple
10b0ade627
Merge pull request #947 from lcybo/master
...
修复group模式报错
2018-09-17 19:51:12 +08:00
WithLin
1a8d6e65cf
FIx
2018-09-17 11:18:00 +08:00
WithLin
9748fceda8
fix proto3 bug
2018-09-17 11:11:30 +08:00
mcy
7005c11ac2
fix序列化的一些问题, kafka生产端统一使用异步
2018-09-17 11:10:50 +08:00
XiaoFu
88bf2ae64d
Merge pull request #3 from alibaba/master
...
merge local repo
2018-09-17 10:55:55 +08:00
Chuanyi Li
cae6df1457
Update grafana tmpl.
2018-09-15 13:28:27 +08:00
Chuanyi Li
6682c56b9f
Canal metrics group mode support.
2018-09-15 13:21:38 +08:00
agapple
5394613ba6
Merge pull request #942 from wingerx/master
...
增加当前的gtid相关信息至Entry Header
2018-09-14 16:53:41 +08:00
winger
6e84b98651
example 增加获取当前gtid相关信息示例
2018-09-14 14:22:55 +08:00
winger
af1a6a851f
Merge remote-tracking branch 'upstream/master'
2018-09-14 14:07:02 +08:00
winger
1516cf779d
将当前的gtid,sequence no 和last committed信息增加至Entry(trx begin/end, rowdata) Header 中,客户端可从property中获取相关值
2018-09-14 14:06:32 +08:00
mcy
db56effd91
整理代码
2018-09-14 11:45:52 +08:00
mcy
f3d1c8b754
Merge branch 'master' of https://github.com/rewerma/canal
2018-09-14 11:24:27 +08:00
rewerma
abf6a37f3a
Merge pull request #6 from alibaba/master
...
merge alibaba/canal
2018-09-14 11:24:09 +08:00
mcy
e8e0032404
增加扁平Message用于卡夫卡数据投递
2018-09-14 11:22:47 +08:00
agapple
52734eac7e
Merge pull request #938 from WithLin/master
...
Fix upgrade proto2 to proto3
2018-09-13 18:53:10 +08:00
WithLin
ca61be5f5a
fix upgrade proto2 to proto3
2018-09-13 18:37:26 +08:00
XiaoFu
b28e3d6f18
Merge pull request #2 from alibaba/master
...
pull request
2018-09-13 15:28:54 +08:00
agapple
1ab1f119b8
Merge pull request #931 from rewerma/master
...
fix #904 : 空记录时sleep 1s防止循环get数据过快
2018-09-12 13:22:19 +08:00
agapple
a332f23b11
Merge pull request #919 from WithLin/master
...
Fix upgrade protobuf version
2018-09-12 13:20:40 +08:00
mcy
a6798c61df
空数据sleep 100ms
2018-09-12 09:03:43 +08:00
machey
8ae8f526a6
fix #904 : 空记录时sleep 1s防止循环get数据过快
2018-09-11 22:47:53 +08:00
XiaoFu
847634a0f2
Merge pull request #1 from alibaba/master
...
pull a request
2018-09-11 17:13:48 +08:00
agapple
bc8f201b21
Merge pull request #927 from rewerma/master
...
fix #912 解决guava冲突问题
2018-09-11 12:31:24 +08:00
mcy
e450c3f83f
fix #912 通过maven插件将guava修改包路径打包进canal.client
2018-09-11 11:35:47 +08:00
rewerma
32910b5983
Merge pull request #5 from alibaba/master
...
merge from alibaba/canal
2018-09-11 02:19:20 +08:00
WithLin
a497962153
Fix upgrade protobuf version
2018-09-07 14:27:19 +08:00
七锋
82f8a9fc98
fixed issue #483 , show slave hosts
2018-09-04 12:55:16 +08:00
七锋
f5bf1667a9
fixed mq and client launcher
2018-09-04 12:35:20 +08:00
七锋
a9cccb3017
fixed format
2018-09-04 11:39:23 +08:00
七锋
47ac10ca18
fixed issue #868 , NPE fixed
2018-09-04 11:28:56 +08:00
agapple
d4a70d5eea
Merge pull request #900 from rewerma/master
...
kafka server端代码调整
2018-09-04 10:55:04 +08:00
agapple
e78de8568e
Merge pull request #902 from wingerx/master
...
fix bug #890 : 并行解析 + Gtid .没有初始化LogContext中的gtidSet
2018-09-04 10:53:07 +08:00
mcy
728550cac3
增加kafka producer send结果同步判断
2018-09-04 09:56:51 +08:00
mcy
81c216f1c1
增加kafka get的超时时间
2018-09-04 09:39:02 +08:00
mcy
17f345bfe5
0.11的环境未测过,先去除kafka的事务
2018-09-03 18:07:43 +08:00
mcy
ebf9139762
增加kafka producer sender的callback,canal和kafka同步提交回滚
...
去除一个canal实例对应多个kafka topic的机制,一个实例只对应一个topic
kafka模式下server端的批次大小不能超过1M,最大为900K
2018-09-03 17:40:30 +08:00
winger
7de40091a3
fix bug #890
2018-09-03 15:28:15 +08:00
machey
ee5775ce05
去掉kafka server端TRANSACTIONBEGIN和TRANSACTIONEND的判断
2018-09-02 20:21:07 +08:00
agapple
21ef2e5dd4
Merge pull request #896 from lcybo/master
...
修复execTime快于canal当前时间,delay无data points
2018-08-31 13:59:57 +08:00
agapple
283956ee93
Merge pull request #894 from zhangxin1988/master
...
fix #893 index name contains "on" keyword
2018-08-31 13:59:29 +08:00
Chuanyi Li
06275a46ed
Fix no data points while execTime exceeding current time of canal server.
2018-08-29 19:52:09 +08:00
张鑫
ea81b1dc92
fix #893 index name contains "on" keyword
2018-08-29 14:37:27 +08:00
agapple
fd5cfe23db
Merge pull request #892 from rewerma/master
...
kafka client keep alive间隔时间
2018-08-28 17:47:31 +08:00
mcy
bcf30a9a05
去掉kafka canalBatchSize使用默认50
2018-08-28 15:52:36 +08:00
mcy
d5122dcf50
Merge branch 'master' of https://github.com/alibaba/canal
2018-08-28 15:49:27 +08:00
mcy
b5e05c8c77
kafka client keep alive间隔时间
2018-08-28 13:51:23 +08:00
agapple
9434ed513e
Merge pull request #881 from wingerx/master
...
fix bug: 并行解析模式下,开启gtid 会导致解析错误
2018-08-26 22:00:59 +08:00
winger
6fe3ef43d8
fix bug: 并行解析模式下,开启gtid 会导致解析错误
2018-08-25 09:17:13 +08:00
winger
c1f92858a2
fix bug: 并行解析模式下,开启gtid 会导致解析错误
2018-08-25 03:54:38 +08:00
agapple
00b5ade787
Merge pull request #876 from rewerma/master
...
整合 kafka 到 server 和 client
2018-08-24 12:05:07 +08:00
mcy
6b94f396ff
移除kafka client基于zk的HA机制
2018-08-24 10:52:04 +08:00
mcy
b7de1e5070
删除kafka kafka-client模块
2018-08-24 09:14:52 +08:00
machey
4fe6c36c49
Merge branch 'develop-tmp'
...
# Conflicts:
# kafka-client/pom.xml
# kafka/pom.xml
2018-08-23 23:59:20 +08:00
agapple
899592ce2a
Merge pull request #873 from lcybo/master
...
单核环境下创建线程池会出错。
2018-08-23 19:17:47 +08:00
Chuanyi Li L
8585761f42
Merge branch 'master' of https://github.com/lcybo/canal
2018-08-23 17:52:23 +08:00
Chuanyi Li L
1aa2e1a409
Ensure at least 1 thread for thread pool.
2018-08-23 17:51:25 +08:00
mcy
9e3d4a7ffe
HBase读配置空行的bug
2018-08-23 17:43:53 +08:00
mcy
fc3de4b7fd
整合canal.client和canal.kafka-client
2018-08-23 17:38:17 +08:00
mcy
e7f07d7d3e
整合canal.server和canal.kafka
2018-08-23 17:33:15 +08:00
七锋
6e07021223
fixed client version 1.1.1-SNAPSHOT
2018-08-23 14:27:16 +08:00
agapple
3c80b6c1f7
Merge pull request #865 from rewerma/master
...
fix #849 : HBase数据同步适配
2018-08-23 13:58:23 +08:00
mcy
20b0b39b14
fix #849 : hbase数据同步适配
2018-08-23 12:02:44 +08:00
lcybo
de59d22429
Merge pull request #861 from Lee-Think/master
...
Client QPS指标的datasource配置项由"Prometheus"改为取$datasource参数
2018-08-21 18:59:36 +08:00
lixiang
1bef1b72bc
Client QPS指标的datasource配置项由"Prometheus"改为取$datasource参数
2018-08-21 17:20:00 +08:00
mcy
47348e2e96
新增client-launcher模块,外部数据落地适配器的总入口
2018-08-20 18:22:11 +08:00
七锋
0f3c427e28
fixed docker run
2018-08-20 14:28:12 +08:00
七锋
9bde69b6d6
[maven-release-plugin] prepare for next development iteration
2018-08-20 13:29:12 +08:00
七锋
dd8b1ce955
[maven-release-plugin] prepare release canal-1.1.0
2018-08-20 13:28:57 +08:00
七锋
cb884094d5
fixed metrics
2018-08-20 13:01:22 +08:00
agapple
f567abdaee
Merge pull request #855 from lcybo/master
...
Remove TPS(events) in tmpl.
2018-08-20 10:16:03 +08:00
Chuanyi Li
02757693b4
Remove TPS(events) in tmpl.
2018-08-20 08:02:20 +08:00
agapple
35797ca6ff
Merge pull request #854 from lcybo/master
...
根据comments的改进
2018-08-19 20:48:23 +08:00
Chuanyi Li
5588da59b9
Update response time image.
2018-08-19 18:19:18 +08:00
Chuanyi Li
fbb3b814c0
Improve image.
2018-08-19 17:40:53 +08:00
Chuanyi Li
2784f33b52
Improve metrics.
2018-08-19 17:01:03 +08:00
Chuanyi Li
2656d1d2af
Improve overview image.
2018-08-18 17:32:03 +08:00
Chuanyi Li
b6359d014f
Add overview image.
2018-08-18 17:24:54 +08:00
agapple
a4445043c1
Merge pull request #853 from lcybo/master
...
修复启动时,没读到带execTime时,出现48年delay。
2018-08-18 13:59:54 +08:00
Chuanyi Li
59169876eb
Update images.
2018-08-18 12:21:24 +08:00
Chuanyi Li
d06ecdef20
Introduce grafana template, update images.
2018-08-18 12:20:11 +08:00
Chuanyi Li
4a10986b5f
Introduce grafana template, update images.
2018-08-18 11:15:53 +08:00
Chuanyi Li
e81b4279b8
Merge branch 'master' of https://github.com/alibaba/canal
2018-08-17 20:00:51 +08:00
Chuanyi Li
a6abe7fa82
Avoid 48 years delay at startup.
2018-08-17 19:55:08 +08:00
七锋
10a80b2752
fixed compiler
2018-08-17 19:55:08 +08:00
七锋
0131c3ad13
fixed merge code
2018-08-17 19:55:08 +08:00
mcy
62f975deeb
加上 if (logger.isDebugEnabled()) 防止message.toString每次都会被运行,message过大会卡cpu
2018-08-17 19:55:08 +08:00
winger
2accfbf5db
升级Kafka 版本至 2.11_1.1.1
2018-08-17 19:55:08 +08:00
yfpeng
7ed6fcdf04
debug memory leak
2018-08-17 19:55:08 +08:00
七锋
156fc0edbe
fixed docker build
2018-08-17 19:55:08 +08:00
七锋
c421ff718b
preapre for 1.1.0 release
2018-08-17 19:55:08 +08:00
七锋
cc31e2db7c
fixed docker build
2018-08-17 19:55:07 +08:00
七锋
10114f4a9f
fixed issue #727 , support rds binlog dump
2018-08-17 19:55:07 +08:00
七锋
e879216fa4
fixed compiler
2018-08-17 10:40:51 +08:00
agapple
f0ea893bf4
Merge pull request #845 from lcybo/master
...
Add header size for each packet.
2018-08-17 00:25:40 +08:00
Chuanyi Li
3053b9635a
Add header size for each packet.
2018-08-16 07:59:45 +08:00
七锋
a1588e5f98
fixed merge code
2018-08-15 19:45:11 +08:00
agapple
1fd623311e
Merge pull request #841 from lcybo/master
...
Create canal prometheus docs.
2018-08-15 17:25:43 +08:00
agapple
a480ef60ea
Merge pull request #844 from rewerma/master
...
加上 if (logger.isDebugEnabled()) 防止message.toString每次都会被运行,message过大会卡cpu
2018-08-15 17:23:27 +08:00
mcy
4776552605
加上 if (logger.isDebugEnabled()) 防止message.toString每次都会被运行,message过大会卡cpu
2018-08-15 14:26:55 +08:00
Chuanyi Li
efb7adc967
Create canal prometheus docs.
2018-08-14 22:24:50 +08:00
agapple
feb2af060f
Merge pull request #839 from payonxp/master
...
Debug Memory Leak
2018-08-14 16:39:41 +08:00
agapple
15526aab8c
Merge pull request #840 from wingerx/master
...
升级Kafka 版本至 2.11_1.1.1
2018-08-14 16:37:09 +08:00
winger
679fd464f4
升级Kafka 版本至 2.11_1.1.1
2018-08-14 16:09:44 +08:00
yfpeng
c8a32b578c
debug memory leak
2018-08-14 15:59:08 +08:00
Payon
84f3d92790
Merge pull request #1 from alibaba/master
...
merge
2018-08-14 14:04:47 +08:00
七锋
13291c8d7b
fixed docker build
2018-08-14 13:38:01 +08:00
七锋
8a74504fe3
preapre for 1.1.0 release
2018-08-14 13:29:03 +08:00
七锋
11d4761bcb
fixed docker build
2018-08-14 13:23:24 +08:00
agapple
72213bb80d
Merge pull request #833 from lcybo/master
...
store增加bufferSize,metrics server端口可配置
2018-08-13 22:42:01 +08:00
Chuanyi Li
e8aee3a276
Configurable metrics server port.
2018-08-13 21:50:50 +08:00
Chuanyi Li
a3bf1d59e6
Add size label for store metrics.
2018-08-13 21:03:30 +08:00
七锋
d3f52c6d3d
fixed issue #727 , support rds binlog dump
2018-08-13 10:16:28 +08:00
agapple
fb1126cf39
Merge pull request #828 from lcybo/master
...
canal 性能指标采集
2018-08-10 23:22:52 +08:00
Chuanyi Li
ec00792475
Enhance heartbeat, rowscount.
2018-08-09 23:54:53 +08:00
Chuanyi Li
d7bbb0d1a7
Reformat code.
2018-08-09 23:54:53 +08:00
Chuanyi Li
dfd58f4aa1
Improve sink blocking time resolution.
2018-08-09 23:54:53 +08:00
Chuanyi Li
179afb0340
Canal metrics snapshot version.
2018-08-09 23:54:52 +08:00
Chuanyi Li L
fec9803aae
Refactor metrics code.
2018-08-09 23:54:00 +08:00
Chuanyi Li
75de57c102
Prometheus refactor.
2018-08-09 23:51:26 +08:00
Chuanyi Li L
2084b1fc37
Add listener to write.
2018-08-09 23:51:25 +08:00
qmzhang
07d4d2023a
instance由manager管理时,CanalParameter#MetaMode增加本地文件方式,本地meta.dat存储位点信息;
2018-08-09 23:51:24 +08:00
七锋
fac278150e
fixed issue #801 , support canal docker
2018-08-09 23:48:06 +08:00
Chuanyi Li
da5fb30191
canal server metrics refactor.
2018-08-09 23:45:38 +08:00
Chuanyi Li L
01e74c73e2
Reformat code.
2018-08-09 23:43:26 +08:00
Chuanyi Li L
782ef7fe14
Netty server/client profiler skeleton.
2018-08-09 23:43:26 +08:00
Chuanyi Li L
bd14848600
Builder of Aggregator.
2018-08-09 23:42:27 +08:00
Chuanyi Li
1c245280c7
netty3 future listener for metrics.
2018-08-09 23:42:27 +08:00
七锋
d7f48f534b
fixed encoding example
2018-08-09 22:23:12 +08:00
七锋
8ce320148c
fixed code
2018-08-09 22:20:54 +08:00
七锋
3eef7b583d
Merge branch 'branch-rds-support' of github.com:alibaba/canal
2018-08-09 21:55:33 +08:00
agapple
89a32aaabd
Merge pull request #825 from lcybo/master
...
Remove dirty test case
2018-08-09 11:38:48 +08:00
charles.lin
b53131553e
Commit test case
2018-08-09 02:01:44 +08:00
charles.lin
68d8afae3e
Merge commit '9e816bc48f9955f9e2839873993cef9627c2f389' into branch-rds-support
...
Conflicts:
instance/manager/src/main/java/com/alibaba/otter/canal/instance/manager/CanalInstanceWithManager.java
instance/manager/src/main/java/com/alibaba/otter/canal/instance/manager/model/CanalParameter.java
parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/AbstractMysqlEventParser.java
parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/MysqlEventParser.java
2018-08-09 02:01:00 +08:00
Chuanyi Li
92f24bd02e
Remove dirty test case
2018-08-08 20:59:09 +08:00
charles.lin
61c7f7738d
rds binlog 下载支持
2018-08-08 19:29:52 +08:00
七锋
9e816bc48f
support otter use tableMetaTSDB
2018-08-08 18:54:57 +08:00
agapple
377a72e1c0
Merge pull request #814 from payonxp/pyf2
...
schema history storage interface
2018-08-08 10:36:41 +08:00
Payon
b1dc5bd59f
Merge branch 'master' into pyf2
2018-08-07 19:29:27 +08:00
七锋
23f7b3b5d8
fixed issue #818 , tableMeta tsdb bugfix
2018-08-07 18:51:23 +08:00
agapple
09339333bb
Merge pull request #816 from wingerx/master
...
fix ci: fixed compiler java 1.7
2018-08-07 18:23:41 +08:00
七锋
f36ce647e6
fixed issue #781 , upgrade fastsql 540
2018-08-07 17:46:36 +08:00
winger
6d3584b6fb
移除canal.instance.spring 依赖后,需要加入druid与mysql connector的依赖 2. PropertyPlaceholderConfigurer由canal.instance.spring移至db
2018-08-07 16:59:55 +08:00
七锋
4006cedaad
fixed issue #781 , 修复部分DDL解析异常
2018-08-07 16:44:40 +08:00
七锋
cd0bf60824
fixed compiler java 1.7
2018-08-07 16:19:58 +08:00
agapple
c4c45d9e0b
Merge pull request #813 from wingerx/master
...
fix #802 : 从otter中剥离MySQL 相关同步实现,作为example的参考
2018-08-07 15:50:09 +08:00
yfpeng
02868d8fec
为了解决回追数据时Rowdata与当前schema不匹配
...
对TableMeta提供持久化接口,可以根据timestamp匹配历史schema
2018-08-07 13:42:29 +08:00
winger
7d9e2dc69b
fix #802 : 从otter中剥离MySQL 相关同步实现,作为example的参考
2018-08-07 12:04:57 +08:00
agapple
7c7ce43455
Merge pull request #810 from wingerx/master
...
fix bug: kafka get row data for performance
2018-08-06 12:19:08 +08:00
winger
119c5a6971
Merge remote-tracking branch 'upstream/master'
2018-08-06 11:19:58 +08:00
winger
8a952d3a5f
fix bug: kafka get row data for performance
2018-08-06 11:11:57 +08:00
agapple
764e1b6dc0
Merge pull request #807 from qmz/master
...
instance with manager模式一些微调
2018-08-06 10:11:53 +08:00
qmzhang
4e5e2f84e0
Merge branch 'master' of https://github.com/alibaba/canal
2018-08-05 19:45:59 +08:00
qmzhang
3c716e2a43
instance由manager管理时,CanalParameter#MetaMode增加本地文件方式,本地meta.dat存储位点信息;
2018-08-05 19:40:14 +08:00
七锋
872dad8ce8
fixed issue #801 , optimizer docker
2018-08-04 10:37:55 +08:00
agapple
bd6ab1cc80
Merge pull request #806 from wingerx/master
...
支持GTID模式下,默认获取当前gtid值作为起始值
2018-08-03 19:48:42 +08:00
七锋
7fd958a490
fixed issue #801 , support canal docker
2018-08-03 17:48:32 +08:00
winger
da1ce51a0f
支持GTID模式下,通过获取当前gtid值
2018-08-03 11:11:38 +08:00
七锋
26edbeaa28
fixed kafka performance
2018-08-02 13:58:41 +08:00
七锋
93ebc7b973
fixed unused repo
2018-08-01 18:25:49 +08:00
agapple
50d1ec583b
Merge pull request #790 from wingerx/master
...
kafka producer 适配 row data for performance #726
2018-07-31 13:11:49 +08:00
winger
3d5f13fec8
kafka producer 适配 row data for performance #726
2018-07-31 10:34:19 +08:00
文哥
fe12a8481f
Merge pull request #788 from lcybo/master
2018-07-29 22:19:43 +08:00
Chuanyi Li
1eaf198acf
Revert test code.
2018-07-29 15:06:30 +08:00
Chuanyi Li
c0a40499b0
Canal monitoring(prometheus module) snapshot version.
2018-07-29 14:55:38 +08:00
七锋
8cfb70e080
fixed issue #782 , 重复了exception
2018-07-26 16:05:33 +08:00
agapple
d624358cb5
Merge pull request #782 from lcybo/master
...
MysqlMultiStageCoprocessor健壮性enhance
2018-07-26 15:51:39 +08:00
Chuanyi Li L
72b907a75f
Further improvement for issue #771 .
2018-07-26 15:22:38 +08:00
agapple
698573b14a
Merge pull request #780 from wingerx/master
...
fix bug #776
2018-07-26 15:13:25 +08:00
Chuanyi Li L
129051a56e
Further improvement for issue #771 .
2018-07-26 14:30:42 +08:00
winger
e608e1d601
fix bug #776
2018-07-26 12:33:10 +08:00
agapple
22a0d88fe9
Merge pull request #777 from wingerx/master
...
fix issue #771 #776 #756
2018-07-26 10:07:36 +08:00
winger
ccd1e52411
fix issue #771 #776 756
2018-07-25 16:38:38 +08:00
winger
aaf18ccd7e
fix issue #771 #756
2018-07-25 10:18:15 +08:00
agapple
62b1c1ea93
Merge pull request #768 from CAI1987/patch-4
...
修改Readme.md,新增数据订阅活动公告
2018-07-23 15:44:34 +08:00
CAI1987
20807e58c8
Update README.md
2018-07-23 15:39:23 +08:00
七锋
89eb3d6078
fixed test code
2018-07-20 16:45:09 +08:00
七锋
7b52568575
fixed unused code
2018-07-20 16:43:00 +08:00
七锋
d520260fe8
remove unused
2018-07-20 14:46:52 +08:00
七锋
77c1c65b83
fixed issue #726 , 提交测试用例
2018-07-20 14:32:51 +08:00
七锋
fe38bc16d2
fixed issue #726 , 优化完毕
2018-07-20 14:32:13 +08:00
agapple
b4c6490c94
Merge pull request #762 from CAI1987/patch-3
...
修改Readme.md 新增DTS说明
2018-07-19 20:24:44 +08:00
CAI1987
67f2e55d38
Update README.md
2018-07-19 20:14:49 +08:00
CAI1987
b9d7f0b6d0
Update README.md
2018-07-19 20:14:19 +08:00
CAI1987
b880d96a86
新增商业化版本说明
2018-07-19 20:13:01 +08:00
CAI1987
b9156936ae
新增商业版本说明
2018-07-19 20:12:03 +08:00
CAI1987
617f9bbc62
添加Canal商业化版本更新说明
2018-07-19 19:24:37 +08:00
七锋
b19eaeb89a
fixed issue #726 , 单链接复用ByteBuffer数组
2018-07-19 17:55:53 +08:00
七锋
5582a38930
fixed issue #726 , 优化SessionHandler里直接拼byte[],绕过protobuf的多次拷贝
2018-07-19 13:35:38 +08:00
agapple
c6eee47af6
Merge pull request #759 from wingerx/master
...
append gtid lastCommitted and sequenceNumber support
2018-07-18 19:26:51 +08:00
七锋
10bb800f85
fixed issue #726 , 优化SessionHandler的传输处理,提前序列化Entry
2018-07-18 18:21:45 +08:00
winger
89726a6365
append gtid lastCommitted and sequenceNumber support
2018-07-18 17:07:39 +08:00
七锋
8e856acac5
fixed issue #742 , improve h2 config
2018-07-17 22:32:57 +08:00
七锋
df8fe4a9eb
fixed issue #756 , improve exception logger
2018-07-17 22:15:42 +08:00
agapple
33a2a6121a
Merge pull request #754 from wingerx/master
...
fix issue #751
2018-07-17 21:04:18 +08:00
winger
441d2d2449
fix issue #751
2018-07-17 12:04:27 +08:00
七锋
bef6a66eaf
fixed issue #296 , support getWithoutAck/ack/rollback for NPE
2018-07-16 23:00:35 +08:00
七锋
c1805a4831
format DruidDdlParser
2018-07-16 22:54:35 +08:00
agapple
38eecd9aef
Merge pull request #747 from DinoZhang/master
...
add restart.sh
2018-07-16 22:52:46 +08:00
agapple
cef431c8af
Merge pull request #734 from qmz/master
...
add create database support
2018-07-16 22:52:04 +08:00
七锋
3efd589cb1
fixed issue #724 , retry for broke pipe
2018-07-16 22:45:16 +08:00
DinoZhang
92c570e967
Merge pull request #1 from DinoZhang/DinoZhang-patch-1
...
Create restart.sh
2018-07-12 15:53:49 +08:00
DinoZhang
cf7af17aec
Create restart.sh
2018-07-12 15:42:54 +08:00
agapple
3308bf0662
Merge pull request #737 from lcybo/master
...
Parallel参数细节的完善
2018-07-06 15:32:45 +08:00
Chuanyi Li
be605617c3
Parallel参数细节的完善
2018-07-05 20:24:42 +08:00
qmzhang
bb8fec963b
add create/drop databases event support
2018-07-05 16:57:36 +08:00
七锋
da8bf59d5b
fixed issue #726 , 多线程解析binlog DML事件,提升性能
2018-07-04 23:37:20 +08:00
qmzhang
54168af790
add create database support
2018-07-03 17:25:08 +08:00
七锋
f0bed4c762
fixed issue #726 优化时间类型的解析,速度从20MB提升到45MB
2018-07-03 14:52:48 +08:00
七锋
4d4d97419c
fixed issue #726 , 去掉socket receiveBuffer/sendBuffer的设置,影响网络吞吐量
2018-07-03 13:42:31 +08:00
七锋
41eef9a090
fixed issue #729 , isDdl bug
2018-07-02 14:34:46 +08:00
七锋
9ae6c0c863
fixed find event position
2018-06-27 18:33:48 +08:00
agapple
5f47809c8e
Merge pull request #709 from rewerma/master
...
增加canal-kafka-client的running状态监控
2018-06-21 14:25:22 +08:00
rewerma
f2e3ff2dae
增加canal-kafka-client的running状态监控
2018-06-21 11:30:11 +08:00
七锋
92778be5be
fixed fastsql version
2018-06-21 10:44:07 +08:00
agapple
5da8d391f8
Merge pull request #700 from rewerma/master
...
降低kafka依赖版本,申明server的running为volatile
2018-06-21 10:42:47 +08:00
mcy
f867b183ab
降低kafka依赖的版本为0.9.0.1
...
申明server的running为volatile
2018-06-18 12:15:28 +08:00
rewerma
ea555df315
Merge pull request #4 from alibaba/master
...
merge alibaba/canal
2018-06-15 15:59:37 +08:00
agapple
4af1e5fb84
Merge pull request #698 from nbqyqx/master
...
ClientRunningMonitor shutdown delayExector threadpool #697
2018-06-15 13:25:04 +08:00
machey
bf02db4cbc
fastsql 186 for build
2018-06-14 22:08:08 +08:00
Neal Hu
967f8d6b0f
Fixes #697 ClientRunningMonitor shutdown delayExector threadpool
2018-06-14 21:28:10 +08:00
Neal Hu
4f4b016da3
Merge pull request #2 from alibaba/master
...
merge master
2018-06-14 21:19:45 +08:00
七锋
a4255a6377
fixed format
2018-06-14 19:25:34 +08:00
agapple
dca1b20043
Merge pull request #695 from rewerma/master
...
增加kafka对canal binlog信息的生成消费支持
2018-06-14 17:55:31 +08:00
rewerma
025d36604b
Merge pull request #2 from alibaba/master
...
fixed client idleTimeout 1 hour
2018-06-13 18:31:04 +08:00
rewerma
e23a19cd85
整理代码
2018-06-13 18:29:15 +08:00
rewerma
593902d349
修改example的一些bug
2018-06-13 18:25:27 +08:00
rewerma
d014167226
kafka consumer 默认session timeout 修改
2018-06-13 17:57:49 +08:00
rewerma
df668a6f72
kafka 修改日志输出问题
2018-06-13 17:20:16 +08:00
rewerma
cc5eb1075b
kafka consumer example 修改
2018-06-13 15:51:28 +08:00
rewerma
19f4c5ae1b
kafka consumer 测试类修改
2018-06-13 15:40:49 +08:00
rewerma
4e41ebf746
kafka consumer close方式
2018-06-13 15:38:24 +08:00
rewerma
31cbdb1824
kafka consumer close方式
2018-06-13 15:36:21 +08:00
rewerma
1b6efdf463
修改kafka consumer关闭方式
2018-06-13 15:25:43 +08:00
rewerma
cb6c7ef3e8
完善注释
2018-06-13 14:24:32 +08:00
rewerma
4bd2a79905
kafka pom调整
2018-06-13 14:17:07 +08:00
rewerma
345e22bd2c
kafka 设置独立logback.xml
2018-06-13 14:16:37 +08:00
rewerma
9964bb75b1
kafka 客户端 example 完善
2018-06-13 14:01:30 +08:00
rewerma
ec072a45d8
kafka 客户端 example
2018-06-13 13:49:15 +08:00
rewerma
efb7b32694
kafka producer 修改配置,一个destination可以对应多个kafka topic
2018-06-13 13:36:28 +08:00
Neal Hu
74bc6368f2
stop running in example
2018-06-13 11:15:01 +08:00
rewerma
b96e4dd23a
kafka 客户端测试类
2018-06-13 11:13:35 +08:00
rewerma
d991e6be60
kafka 客户端消费代码整理
2018-06-13 10:34:28 +08:00
rewerma
e7846085fc
kafka 客户端消费完成基本测试
2018-06-12 19:25:03 +08:00
rewerma
6faa3fd586
增加对message的验证,过滤transaction begin end 类型
2018-06-12 13:28:49 +08:00
七锋
fa34eb0e59
fixed client idleTimeout 1 hour
2018-06-12 13:20:41 +08:00
rewerma
3e97e6b771
整理pom格式
2018-06-12 10:53:46 +08:00
rewerma
330da50a5e
修改kafka配置项属性
2018-06-12 10:23:50 +08:00
rewerma
e35a06743c
增加kafka的日志
2018-06-12 09:46:54 +08:00
rewerma
0d6757c257
增加kafka的日志
2018-06-12 09:46:01 +08:00
rewerma
e4cde2f6a1
修改withoutNetty的bug
2018-06-12 09:00:55 +08:00
machengyuan4081
9b7d62717e
kafka system.properties 的 bug
2018-06-11 23:31:02 +08:00
machengyuan4081
b306bde3ec
kafka producer
2018-06-11 23:19:28 +08:00
rewerma
31f72e1aac
增加 kafaka producer 直接从canal server消费数据发送
2018-06-11 19:52:55 +08:00
rewerma
ad201660a6
Merge pull request #1 from alibaba/master
...
pull
2018-06-11 17:21:09 +08:00
七锋
77f1dfd324
fixed heartbeat
2018-06-08 15:03:49 +08:00
七锋
11467fca2a
fixed issue #639 , support rename
2018-06-08 10:56:20 +08:00
agapple
cc8d5b4263
Merge pull request #682 from nbqyqx/master
...
Fix #631 Boolean java type support
2018-06-08 10:45:25 +08:00
Neal Hu
4022aa8b5a
stopRunning in example
2018-06-08 00:00:29 +08:00
Neal Hu
187b98fbda
Boolean Type support. https://github.com/alibaba/canal/issues/631
2018-06-07 23:52:13 +08:00
七锋
0f33c8c89c
fixed issue #677 , add gtidon default value
2018-06-07 14:03:33 +08:00
Neal Hu
b6967dc0dc
Merge pull request #1 from alibaba/master
...
pr
2018-06-07 12:37:14 +08:00
七锋
b734a32ae6
fixed issue #626 , support xa rollback/commit event
2018-06-06 11:39:59 +08:00
七锋
1f16310b7d
fixed issue #663 , ddl parse
2018-06-05 16:05:48 +08:00
七锋
5349a5c49b
fixed issue #657 , fixed ConcurrentModificationException
2018-06-05 16:04:07 +08:00
七锋
a2241e2521
fixed issue #641 , support uk parse
2018-06-05 15:41:03 +08:00
七锋
fedc07352b
fixed issue #662
2018-06-05 14:59:33 +08:00
七锋
e251de79f3
fixed issue #610 , utf8mb4 encode support
2018-05-10 19:53:52 +08:00
七锋
7076e3124d
fixed fastsql
2018-05-10 19:35:17 +08:00
agapple
fca7da6bba
Merge pull request #623 from rewerma/master
...
在CanalConnector接口加入stopRunning方法,用于优雅停止client
2018-05-10 19:34:24 +08:00
七锋
57c2cc4c4e
fixed issue #626 , support mysql xa parse
2018-05-07 21:25:29 +08:00
七锋
3c913d1e22
fixed issue #126 , support gtid
2018-05-07 18:33:37 +08:00
rewerma
4141049bb9
在CanalConnector接口加入stopRunning方法,用于优雅停止client
2018-05-07 15:13:24 +08:00
agapple
912a7a12be
Merge pull request #618 from hiwjd/feature/gtid-support
...
支持通过GTID同步binlog
2018-05-07 10:30:58 +08:00
agapple
5c2ed38d2f
Merge pull request #621 from spccold/master
...
close zkclientx if necessary when stop canal and fix CanalInstanceWithManager#doInitEventParser bug
2018-05-07 10:21:50 +08:00
七锋
c8f1d54fa1
fixed issue #619 , improve code
2018-05-07 10:18:25 +08:00
agapple
e0fa8e0f72
Merge pull request #622 from nbqyqx/master
...
block waiting interrupted by stop request
2018-05-07 10:12:50 +08:00
spccold
7eb6fb3e8a
fix CanalInstanceWithManager#doInitEventParser bug
2018-05-06 21:50:34 +08:00
Neal Hu
debfdb8873
abstract canal client test waiting until running == true
2018-05-05 23:55:57 +08:00
Neal Hu
eda7e4ca2b
block waiting interrupted by stop request
2018-05-05 23:06:16 +08:00
spccold
70e6bdde02
close zkclientx if necessary when stop canal
2018-05-05 11:35:41 +08:00
hiwjd
21f3f8c973
支持通过GTID同步binlog
2018-05-04 16:47:03 +08:00
七锋
f46133d116
upgrade fastsql 228
2018-04-18 13:30:31 +08:00
七锋
9b7de00efb
fixed performace
2018-04-12 20:10:48 +08:00
七锋
c340bd6565
upgrade fastsql 159
2018-03-16 15:10:02 +08:00
七锋
511734c3d8
fixed compiler error
2018-03-15 20:21:42 +08:00
七锋
af002f4e24
fixed bio socket
2018-03-15 20:20:29 +08:00
七锋
28ad12d0ea
upgrade fastsql 2.0.0_preview_151
2018-03-15 15:48:16 +08:00
agapple
6229a8593f
Merge pull request #555 from whaon/patch-1
...
renew an InetSocketAddress to resolve address again
2018-03-15 14:33:05 +08:00
whaon
256056e14f
renew an InetSocketAddress to resolve address again
...
resolve [issue427](https://github.com/alibaba/otter/issues/427 )
2018-03-14 09:55:20 +08:00
agapple
499be8bd8c
upgrade druid to fastsql
2018-03-13 16:28:08 +08:00
agapple
cd87ef00cc
fixed issue #553 , merge code
2018-03-13 10:00:11 +08:00
agapple
6b7109c66b
fixed issue #539 , support bio&netty
2018-03-12 23:21:43 +08:00
七锋
b90c9fac41
fixed druid version 1.1.9
2018-03-12 17:14:12 +08:00
agapple
88c79544f0
Merge pull request #532 from LavaCoref/hotfix/lava/1_json
...
fix(dbsync): json column of zero length has no value, value parsing s…
2018-03-12 16:37:50 +08:00
agapple
fddaff1bd9
Merge pull request #536 from Wu-Jianqiang/master
...
主要修复 SocketChannel 默认缓存大小(1MB)不够用时需自动扩充,否则将因缓存空间不足而造成I/O超时假象
2018-03-12 16:36:07 +08:00
七锋
847ebf9bf3
fixed issue #535 , use show create table to get tableMeta
2018-03-12 16:27:58 +08:00
Wu-Jianqiang
3e7e7b7f6e
修改:变量命名和super调用
2018-02-26 16:37:21 +08:00
Wu-Jianqiang
06e7f44114
修复:MASTER_HEARTBEAT_PERIOD 的计量单位是秒(可以包含3位小数表示毫秒),但不是纳秒。
2018-02-26 16:31:58 +08:00
Wu-Jianqiang
8ad603fea4
修复:SocketChannel 默认缓存大小(1MB)不够用时需自动扩充,否则将因缓存空间不足而造成I/O超时假象
2018-02-26 16:26:01 +08:00
WU Jianqiang
863a61d626
Merge pull request #2 from alibaba/master
...
merge
2018-02-23 23:17:46 +08:00
lvtianyu
7b38542183
fix(dbsync): json column of zero length has no value, value parsing should be skipped
2018-02-23 10:41:49 +08:00
agapple
0af789b1c7
Merge pull request #529 from yakirChen/master
...
TimelineTransactionBarrier import CanalSinkException; Maven Compile 的一些 Warning
2018-02-12 11:43:57 +08:00
agapple
2d49b709ca
fixed socket wait period 10ms
2018-02-12 11:43:03 +08:00
agapple
826a45c105
Merge pull request #528 from lcybo/timeout
...
Use mysql master heartbeat to detect phycial tcp connection failure.
2018-02-12 11:41:55 +08:00
yakirChen
03452dcdda
Merge branch 'master' of github.com:yakirChen/canal
2018-02-12 11:29:16 +08:00
yakirChen
514876f60f
[x] Fix Compile Error : TimelineTransactionBarrier.java:[70,27] 找不到符号: 类 CanalSinkException
...
[x] Fix Maven Wranning: The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[x] Fix MavenWranning : 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-jar-plugin is missing.
2018-02-12 11:28:42 +08:00
yakirChen
89994c52f9
[x] Fix Compile Error : TimelineTransactionBarrier.java:[70,27] 找不到符号: 类 CanalSinkException
...
[x] Fix Maven Wranning: The expression ${pom.version} is deprecated. Please use ${project.version} instead.
[x] Fix MavenWranning : 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-jar-plugin is missing.
2018-02-12 11:17:54 +08:00
agapple
edc2fbe1dc
fixed issue #507
2018-02-12 11:15:43 +08:00
agapple
cfa90af33c
fixed unique and upgrade druid
2018-02-12 11:01:53 +08:00
Chuanyi Li
32d4174083
Merge branch 'timeout' of https://github.com/lcybo/canal into timeout
2018-02-11 00:16:07 +08:00
Chuanyi Li
bb0f3b3a7e
[MI] Use mysql master heartbeat to detect phycial tcp connection
...
failure.
2018-02-11 00:10:16 +08:00
Chuanyi Li
dc0010823f
[MI] Use mysql master heartbeat to detect phycial tcp connection
...
failure.
2018-02-10 23:42:06 +08:00
agapple
b1431f8827
Merge pull request #521 from lcybo/monitor
...
修改InstanceConfig未生成或已销毁时造成ServerRunningMonitor running状态与实际不一致的问题
2018-02-10 11:22:48 +08:00
agapple
b9e3629459
Merge pull request #522 from lulu2panpan/lulu2panpan-patch-1
...
修复死锁bug
2018-02-10 11:18:22 +08:00
agapple
31ed4efe3a
Merge pull request #497 from lcybo/master
...
通信模块log小优化
2018-02-10 11:15:44 +08:00
Chuanyi Li
6da1507405
Rollback running state and znode when start failed.
2018-02-06 20:54:33 +08:00
WU Jianqiang
0b82ee8d10
Merge pull request #1 from alibaba/master
...
pull & merge
2018-02-02 16:13:21 +08:00
Chuanyi Li
00890f87e5
Communication log optimization.
2018-01-18 21:11:46 +08:00
agapple
91ac0e30aa
fixed issue #483 , support show slave hosts
2018-01-10 14:35:26 +08:00
agapple
9316a3df6d
fixed issue #482 , retry for getTableMetaByDB
2018-01-10 13:49:25 +08:00
agapple
2d31e6bf91
Merge pull request #487 from jasonhx140/master
...
dump connection is disconnected
2018-01-10 13:41:30 +08:00
jason huang
a965d2cd04
dump connection is disconnected
...
dump connection is disconnected since SocketChannel.cache is overflow.
2018-01-09 18:25:51 +08:00
jason huang
93be9d1909
dump connection disconnected
...
dump connection will be disconnected since SocketChannel.cache is overflow.
2018-01-09 18:21:14 +08:00
jason huang
7cf9375ac6
Merge pull request #2 from alibaba/master
...
merge new release
2018-01-09 18:10:19 +08:00
agapple
af289cd9fb
fixed compiler error
2018-01-05 19:09:46 +08:00
agapple
d1f1c0716b
Merge pull request #473 from jasonhx140/master
...
connect mysql server failed when reconnect mysql server frequently
2018-01-05 18:55:18 +08:00
jason huang
0c7aed197a
cannot build mysql connection.
...
when invoke connect(), it will return a ChannelFuture instance, and then the "addListener" method is invoked by biz thread, however, "channelRead" method in BusinessHandler is executed by netty I/O thread.
ChannelFutureListener -> operationComplete() cannot guarantee that which is executed before than BusinessHandler -> channelRead() method.
reproduce it :
set below jvm parameter:
-Dio.netty.eventLoopThreads=1
It will caused new connection is timeout when AbstractEventParser -> start() -> parseThread ->erosaConnection.reconnect() is invoked.
2018-01-02 23:29:15 +08:00
jason huang
325d16bc66
Merge pull request #1 from alibaba/master
...
merge latest version
2018-01-02 23:03:52 +08:00
agapple
3104b4cc24
fixed issue #449 , optimize findTransactionBeginPosition
2017-12-27 17:34:46 +08:00
agapple
9595e6abbd
fixed semi sync format & refactor
2017-12-27 16:53:09 +08:00
agapple
c6f4de9f88
Merge pull request #455 from lucifax301/master
...
mysql semi support and mariadb gtid parse
2017-12-27 16:36:29 +08:00
lucifax301
d66839c965
mysql semi support and mariadb gtid parse
2017-12-18 14:10:53 +08:00
agapple
ac773009f8
Merge pull request #447 from zhmz1326/master
...
解决destination无限连接等待的bug
2017-12-13 10:31:48 +08:00
zhengmingzhi
8b03f172ed
解决destination无限连接等待的bug
2017-12-12 19:17:53 +08:00
agapple
5e206e4f7e
fixed issue #440 , optimize find position
2017-12-10 23:05:28 +08:00
agapple
448fc8bcde
fixed issue #440
2017-12-10 22:27:14 +08:00
agapple
c60b04424b
fixed issue #440 , optime find position
2017-12-10 22:24:24 +08:00
agapple
5aed505429
fixed issue #440 , enableTsdb
2017-12-08 23:21:40 +08:00
agapple
912f5db2c7
fixed issue #440 , for null position
2017-12-08 23:20:15 +08:00
agapple
8b57b9a0a5
fixed issue #442 , compareTableMetaDbAndMemory
2017-12-08 22:54:22 +08:00
agapple
d1c83ea7bb
fixed fastjson autotype
2017-12-05 19:46:49 +08:00
agapple
7d485efd71
Update README.md
2017-12-05 17:01:15 +08:00
agapple
20942533e6
[maven-release-plugin] prepare for next development iteration
2017-12-04 14:43:29 +08:00
agapple
6b2d80a145
[maven-release-plugin] prepare release canal-1.0.25
2017-12-04 14:43:16 +08:00
agapple
01ef15223c
fixed issue #415 , ignore flush privileges
2017-12-04 13:19:58 +08:00
agapple
da3290c381
Merge pull request #424 from lcybo/master
...
1.0.23里面修复的KILL DUMP exception问题在(#334 )里面被覆盖回去了
2017-12-03 21:36:33 -06:00
agapple
a9284b1b39
fixed compiler error
2017-12-04 11:35:02 +08:00
Chuanyi Li
3409472eb9
kill CONNECTION exception fix revert.
2017-11-23 22:25:47 +08:00
agapple
5348994b4a
fixed alisql heartbeat
2017-11-15 10:42:58 +08:00
agapple
a3b9f6f1eb
fixed NPE
2017-11-14 23:44:15 +08:00
agapple
2dc019709b
fixed quota ddl
2017-11-14 23:31:46 +08:00
agapple
c56f58deae
upgrade druid to 1.1.5
2017-11-01 20:29:47 +08:00
lulu2panpan
fa059804ce
修复死锁bug
...
当通过zk-cursor启动的时候,第一个Event类型是TransactionEnd,那么txState变为2的触发条件不仅仅有ddl和dcl,clear方法中isTransactionEnd的判断应该放到txState.intValue() == 2的后面,否则将导致死锁
2017-10-19 10:50:32 +08:00
agapple
8d6f19cc33
fixed default value
2017-10-15 16:19:02 +08:00
agapple
1463463f1e
fixed data
2017-10-15 16:08:29 +08:00
agapple
77342663e3
fixed rds binlog local
2017-10-15 15:55:30 +08:00
agapple
e01e48ff65
fixed h2 support
2017-10-14 01:14:13 +08:00
agapple
4f00f5ea8d
fixed tsdb test
2017-10-14 00:12:43 +08:00
agapple
19707f92d4
merge tsdb meta support and refactor
2017-09-30 23:21:17 +08:00
agapple
3930ea0f9b
Merge pull request #393 from KaimingWan/table_meta_support
...
Table meta support
2017-09-30 15:48:53 +08:00
wanshao
676cf47987
Merge branch 'master' into table_meta_support
...
# Conflicts:
# parse/src/main/java/com/alibaba/otter/canal/parse/inbound/mysql/dbsync/LogEventConvert.java
2017-09-30 15:47:02 +08:00
agapple
788c1d9b84
fixed issue #360 , socket pool bug
2017-09-23 11:50:25 +08:00
agapple
84a9aeb46c
Merge pull request #374 from alexandnpu/feature/avoid_use_multiline_exception_directly
...
try to avoid use multiline exception directly
2017-09-23 11:11:27 +08:00
kaimingwan
e8da1c884b
table meta support
2017-09-22 22:01:57 +08:00
alex.zheng
041cbf04c7
add uncaughtexception handler
2017-09-06 12:07:50 +08:00
alex.zheng
a1cf292baa
try to avoid use multiline exception directly
2017-08-29 16:05:12 +08:00
agapple
67436b2bc4
fixed issue #330 & #350 , json length & escapse
2017-08-03 21:15:09 +08:00
agapple
ca350a79bd
Merge pull request #343 from toruneko/bugfix-when-filterqueryddl
...
Bugfix when filterqueryddl
2017-08-02 00:20:25 +08:00
jianhao.dai
214e404e1b
挪到最前面
2017-07-20 11:37:24 +08:00
jianhao.dai
34bcfbc3cb
不管有没有filter,都应该对meta cache更新一下
2017-07-20 11:35:19 +08:00
HaiDai
402245dbbf
Merge pull request #2 from alibaba/master
...
merge master
2017-07-20 11:29:50 +08:00
agapple
2cebfa04dd
fixed test
2017-07-05 12:48:52 +08:00
agapple
62e8ff6ec8
fixed format
2017-07-05 12:46:32 +08:00
agapple
b265bf4669
Merge pull request #319 from day6/fixbug-clientTimeout
...
fixbug: soTimeout doesn't work.
2017-07-05 12:44:50 +08:00
agapple
989a69e7be
fixed format & import
2017-07-05 12:41:11 +08:00
agapple
780b4f715b
Merge pull request #333 from jasonhx140/master
...
fix bug:异常网络连接导致canal server 无法关闭
2017-07-05 12:38:33 +08:00
agapple
8e88dc87f7
fixed https://github.com/alibaba/canal/pull/334
2017-07-05 12:35:42 +08:00
agapple
867d6607d4
Merge pull request #334 from luoyaogui/master
...
针对使用netty取代JDK的socketchannel实现的优化
2017-07-04 21:50:07 +08:00
agapple
22e3d2f3f1
Merge branch 'master' into master
2017-07-04 21:49:22 +08:00
agapple
ecdd619da7
Merge pull request #331 from alexandnpu/feature/upgrade_zkclient
...
update zkclient to 0.10
2017-07-04 21:38:30 +08:00
luoyaogui
9ba93bae5f
Update DirectLogFetcher.java
2017-06-27 15:08:34 +08:00
luoyaogui
0b2f37a272
Update MysqlConnection.java
2017-06-27 15:07:52 +08:00
luoyaogui
0bd4a1146c
Update DirectLogFetcherTest.java
2017-06-27 15:07:07 +08:00
luoyaogui
3dba400624
Update MysqlUpdateExecutor.java
2017-06-27 15:05:33 +08:00
luoyaogui
523130cf8b
Update MysqlQueryExecutor.java
2017-06-27 15:05:00 +08:00
luoyaogui
525a00ea17
Update MysqlConnector.java
2017-06-27 15:04:39 +08:00
luoyaogui
b6090da0e5
Update PacketManager.java
2017-06-27 15:03:53 +08:00
luoyaogui
9ea88c7863
Update SocketChannelPool.java
2017-06-27 15:03:16 +08:00
luoyaogui
48c108806a
Update SocketChannel.java
2017-06-27 15:02:45 +08:00
Jason Huang
8600e9825b
fix bug:
...
现实运用中出现:client已经不存在但server端的连接仍然是存活状态。
在此种网络异常状态时,stop canal server会一直hang住。
原因:异常网络连接由于无数据传输,导致 io worker线程一直loop selector而无法退出。
解决方案:1. 设置keepalive 由os 监控。
2. 设置netty idle 机制,定时检测并主动close socket。(fix 时间单位bug)
3. 每次新创建socket channel时存储在一个容器内,在stop canal
server时,从容器内主动释放所有socket channel。
2017-06-26 19:24:15 +08:00
alex.zheng
29815c41b0
make zookeeperx work
2017-06-23 20:16:25 +08:00
alex.zheng
717e2cb7f3
update zkclient to 0.10
2017-06-23 14:48:28 +08:00
agapple
3e5b3e1467
fixed issue #321 , process TableIdNotFoundException
2017-06-22 13:37:11 +08:00
baiju
a46ac3b814
fixbug: soTimeout doesn't work.
2017-06-10 10:07:23 +08:00
agapple
f6c2eb8963
fixed issue #296 , NPE
2017-05-11 14:05:58 +08:00
agapple
07b979f242
Merge pull request #293 from MarkLinHz/master
...
fix bug of repeat log manager
2017-04-08 17:02:53 +08:00
yinxiu
6b20959a2d
fix bug of repeat log manager
2017-04-06 20:13:59 +08:00
agapple
fdd40224d5
fixed format & import
2017-04-01 22:20:00 +08:00
agapple
a6604978ed
Merge pull request #291 from MarkLinHz/master
...
重构LogPositionManager并适配XML配置
2017-04-01 22:06:54 +08:00
agapple
4d624cf184
[maven-release-plugin] prepare for next development iteration
2017-04-01 21:18:31 +08:00
agapple
7e026f2495
[maven-release-plugin] prepare release canal-1.0.24
2017-04-01 21:18:11 +08:00
agapple
2e3796cb07
fixed format
2017-04-01 21:04:21 +08:00
agapple
b2a5f482ee
fixed issue #284 , add slave_uuid
2017-04-01 21:01:07 +08:00
yinxiu
a78622ae02
rename log manager module and ajust xml
2017-03-28 20:33:14 +08:00
agapple
e5444ae658
Merge pull request #259 from GitHub-BruceTong/dev
...
fix bug for #202(canal.instance.filter.regex 修改后未生效)
2017-03-28 09:49:18 +08:00
agapple
73627df082
fixed issue #287 , support chinese & empty string valuewq
2017-03-28 00:25:11 +08:00
yinxiu
c0f2d274d7
refactoring log position manager module
2017-03-18 11:41:56 +08:00
agapple
2eb05b5934
fixed compiler error
2017-03-17 21:15:33 +08:00
agapple
83689ee519
fixed issue #274 , support mysql 5.7.17
2017-03-17 20:36:40 +08:00
agapple
d78b389737
revert pull request https://github.com/alibaba/canal/pull/256
2017-03-17 20:00:13 +08:00
agapple
20d8ac67dc
fixed issue #280 , refactor MysqlQueryExecutor use IOException
2017-03-17 19:40:12 +08:00
agapple
19a56fb77e
Merge pull request #282 from sun7059/patch-1
...
Update JsonUtils.java
2017-03-17 19:11:25 +08:00
agapple
c629e8c899
Merge pull request #283 from keyganker/master
...
upgrade fastjson for security
2017-03-17 19:10:58 +08:00
fengyong
75a5a4d7df
升级fastjson
2017-03-16 20:25:21 +08:00
孙鹏
045a2e5a50
Update JsonUtils.java
...
修复升级fastjson到1.2.28后JSONUtils报错的问题
2017-03-16 20:01:42 +08:00
agapple
11d0712291
Update README.md
2017-02-07 19:50:22 +08:00
GitHub-BruceTong
03ff9512dd
fix bug for #202(canal.instance.filter.regex 修改后未生效)
2017-01-22 15:52:04 +08:00
agapple
0ee2e767d2
fixed stop failed
2017-01-19 13:22:40 +08:00
agapple
ff97dcbbc9
format & import
2017-01-19 13:07:53 +08:00
agapple
92c1a51726
Merge pull request #256 from luoyaogui/master
...
使用netty重构socketChannel(jdk内置),修改了PacketManager实现,以及其他相关引用的类。
2017-01-19 12:47:23 +08:00
agapple
36216e63ea
Merge branch 'master' into master
2017-01-19 12:46:41 +08:00
agapple
db4fc68a55
fixed issue #257 , heartBeatTimerTask stop bugfix
2017-01-19 12:34:05 +08:00
agapple
eef58005d9
fixed format
2017-01-12 11:31:43 +08:00
agapple
8141ddc4e8
Merge pull request #250 from toruneko/fix-ha-switch
...
[BUGFIX] 在MySQL5.6做主备库切换时出现的filename乱码修复
2017-01-12 11:30:39 +08:00
agapple
004f26465f
Merge pull request #248 from z070204z/patch-1
...
修复mysql5.6以下报java.lang.NullPointerException
2017-01-12 11:29:52 +08:00
jianhao.dai
5dc62bbda8
seek method also need load checksum
2017-01-04 11:14:01 +08:00
z070204z
f45f1ac74f
Update MysqlConnection.java
...
修复mysql5.6以下报java.lang.NullPointerException
2017-01-03 18:03:42 +08:00
luoyaogui
5c11c71783
使用netty重构socketChannel(jdk内置),修改了PacketManager实现,以及其他相关引用的类。
2017-01-03 14:18:58 +08:00