Release v1.12.8

What's Changed

• [Improve][License] Add apache-2.0 license check. by @FlechazoW in #1386
• [hotfix][jdbc-connector] pgsql query metadata exception by @KinoMin in #1391
• [bugfix][hana]fix hana special char error by @fangxy-7010 in #1390
• [Feat-#1392][core] add parameters in json format by @aubdiy in #1393
• [Improve][Connector][bin-log] Unified exception of MapMakerHelper by @TyrantLucifer in #1395
• fix BUG #1402,fix '\r' problems caused by windows by @zhengchaoken in #1403
• [hotfix][hdfs and oraclelogminer] Solved the problem of splitting columns and handling null values in hdfs components by @conghe2402 in #1404
• fix BUG #1398,fix bsh,xml-resolver default version cannot access by @zhengchaoken in #1399
• fix BUG #1400,fix multiple SLF4J bindings & no log logged in standalo… by @zhengchaoken in #1401
• [bugfix][hbase]fix hbase date type cast int error by @fangxy-7010 in #1406
• [hotfix][hdfs]when writing to hfds,null value is set to '\N' by @conghe2402 in #1408
• [doc-#1415] update doc & starrocks batchsize set by @liumengkai in #1417
• [environment-##1426] delete tmp flink-distribute-cache-xxx dir by @liumengkai in #1427
• [hostfix][hive] add HIVe table check and correct function by @conghe2402 in #1425
• [hotfix][hive] fix bug for try get correct hive table funciton by @conghe2402 in #1429
• [bugfix][Client] Chunjun client support submit task to hadoop with kerberos by @kyo-tom in #1435
• Fix:mysql-cdc can't run in sql mode by @Bricks-Man in #1436
• [feature-#1334][hdfs-connector] fix orc timestamp column can't read by @liumengkai in #1383
• [hotfix-#1449][ClickHouse] fix ClickHouse source null pointer problem by @ll076110 in #1450
• [fix-##1451] add column replace for hbase column by @liumengkai in #1452
• [feat-##1455] fix hbase bug & add hbase ttl by @liumengkai in #1456
• [BugFix][Postgres][#1463] The cast is bad, only when 'rowConverter' instance of the 'JdbcColumnConverter' should cast. by @FlechazoW in #1464
• [BugFix][Jdbc][#1459] Remove the 'checkConnValid', because some connector doesn't support 'isValid'. by @FlechazoW in #1465
• fix Logic error in confProp parameter processing by @ChangjunZhang in #1477
• [feat-#1470][ftp] improvement ftp read/write performance by @mggger in #1483
• [BugFix][hbse-connector][#1485] hbase ttl millisecond not second by @liumengkai in #1486
• [feat][jdbc]improvement jdbc read/write performance by @PaddyMelody in #1488
• [feat-#1487][iceberg]add iceberg writer by @mggger in #1489
• #1494 [feat-1494][http] http support array data by @yanghuaiGit in #1495
• [hotfix-#1497][chunjun-connector-http]Solve the problem that http-x p… by @taoyameng in #1500
• [feat-#1498][main] support run sql job with batch mode by @PaddyMelody in #1504
• [bug][http] commonConf NullPointerException #1510 by @KinoMin in #1511
• [hotfix-#1512][mongodb] Fix the bug that mongodb supports constants by @ll076110 in #1513
• [hotfix-#1501]fix throw NoRestartException can not sotp application by @zhourui999 in #1507

New Contributors

• @aubdiy made their first contribution in #1393
• @TyrantLucifer made their first contribution in #1395
• @Bricks-Man made their first contribution in #1436
• @ChangjunZhang made their first contribution in #1477
• @taoyameng made their first contribution in #1500
• @zhourui999 made their first contribution in #1507

Full Changelog: v1.12.7...v1.12.8

Release v1.12.7

What's Changed

• [hotfix]oracle type modify on sql & adjust to get unique key method by @yanghuaiGit in #1262
• [hotfix][main]Sync jobs disable operator chains by @PaddyMelody in #1263
• [hotfix][column]Fix the issue of timestampColumn convert to long error by @PaddyMelody in #1260
• [hotfix-#1272][chunjun-connector-pgwal]fix pgwal does not support upp… by @momisabuilder in #1273
• [hotfix-#987] [chunjun-connector-hdfs] fixed HdfsOrcOutputFormat can't get fullColumnType or fullColumnName from HdfsConf by @lordk911 in #991
• [hotfix-#565][chunjun-hdfs-connector] hadoop3.x version support orc by @liumengkai in #1279
• [hotfix] ftp writer format null by @chenghb606 in #1264
• [feat][jdbc]init column info in client by @PaddyMelody in #1280
• [hotfix] kudu:GenericRowData can not cast ColumnRowData by @JaryZhen in #1277
• Update LogParser.java by @364220158 in #1013
• [hotfix-#1289][chunjun-connector-jdbc-base] change column size used by @liumengkai in #1290
• [Hotfix][POM] Fix the missing dependency, and rename. by @FlechazoW in #1291
• [feat-#1284][jdbc]get metadata from resultSetMetaData by @PaddyMelody in #1292
• [feat-#1293][chunjun-connector-hdfs] add assembleFieldProps for hdfs-connector by @liumengkai in #1294
• [feat-#1295][e2e]add ftp container by @mggger in #1296
• [bin] display Reference site while submitting job. by @lvyanquan in #1299
• fix(sec): upgrade com.alibaba:fastjson to 1.2.83 by @645775992 in #1303
• [hotfix-#1304][binlog]1.Use version 19 of guava 2. Introduce protobuf… by @qumaosihaozi in #1305
• fix(sec): upgrade org.apache.hive:hive-exec to 3.1.3 by @vvsd in #1310
• fix(sec): upgrade com.amazonaws:aws-java-sdk-s3 to 1.12.261 by @vvsd in #1308
• fix(sec): upgrade com.fasterxml.jackson.dataformat:jackson-dataformat-cbor to 2.11.4 by @vvsd in #1309
• fix(sec): upgrade com.jcraft:jsch to 0.1.54 by @lvyanquan in #1311
• [Improve][README.md] Update the description of 'ChunJun'. by @FlechazoW in #1326
• [feat][jdbc-#1300]add parameter pollingFromMax by @PaddyMelody in #1301
• [Improve][Assembly] Adjust the output and package of assembly. by @FlechazoW in #1327
• [doc-#1329][chunjun-connector-kafka] doc problem by @liumengkai in #1330
• [Feature][CDC] support mysql cdc by @liugddx in #1332
• [Improve][Licenses] Add Apache 2.0 license. by @FlechazoW in #1335
• [Feature][DDL] Support for processing DDL data. by @FlechazoW in #1288
• [feat][standalone-#1338]Remove classpath, userJars, and Artifacts from jobgraph by @PaddyMelody in #1339
• [Improve][HDFS][#1336] Fix the path problem of writing to HDFS. by @zhengchaoken in #1337
• [Improve][DDL][POM] Change the pom of 'ddl-base' by @FlechazoW in #1340
• [HotFix][CORE] Fix the mistaken logic of judging ddl conf. by @FlechazoW in #1343
• [HOTFIX][DDL-Base] Fix the error that the antrun-maven plugin moves the miss target class. by @FlechazoW in #1344
• [HOTFIX][DDL-Base] Fix the error that 'mvn package' failed. by @FlechazoW in #1345
• [hotfix][mysql][e2e] mysql silent unclassified size copy,table names cannot be capitalized by default. by @chaozwn in #1341
• [hotfix][core] change all common lang package to common lang3 package. by @chaozwn in #1346
• [doc] add notes about starting a Flink standalone cluster with chunjun jars by @lvyanquan in #1348
• [Improve][License] File add license. by @FlechazoW in #1349
• [Improve][Connector][Doris] Improve doris source. by @FlechazoW in #1359
• es7 connector fix support keyword type by @fangxy-7010 in #1361
• chore: typo fix of readme by @wey-gu in #1365
• [feat] [chunjun-connector-stream,chunjun-connector-elasticsearch-base… by @gaoasi in https://github.com//pull/1364
• [Hotfix][Connector] Fix the jvm throws java.lang.SecurityException by @FlechazoW in #1366
• [feature-#1353][kafka-connector] add value deocder by @liumengkai in #1371
• [Improve][Connector][FTP] Reactor "ftp-connector". by @FlechazoW in #1367
• [feat-1368][logminer]add enableFetchAll by @mggger in #1369
• [feat-#1379][ftp][docs]add maxFetchSize by @mggger in #1380
• [hotfix][core] fix in local dev run sql mode can't load core jar. by @chaozwn in #1372
• [ftp]fix ftp sql job run error by @fangxy-7010 in #1382

New Contributors

• @lordk911 made their first contribution in #991
• @chenghb606 made their first contribution in #1264
• @JaryZhen made their first contribution in #1277
• @364220158 made their first contribution in #1013
• @645775992 made their first contribution in #1303
• @qumaosihaozi made their first contribution in #1305
• @vvsd made their first contribution in #1310
• @liugddx made their first contribution in #1332
• @zhengchaoken made their first contribution in #1337
• @wey-gu made their first contribution in #1365
• @gaoasi made their first contribution in #1364

Full Changelog: v1.12.6...v1.12.7

Release v1.12.6

What's Changed

• [hotfix-1005][kudu] Add a default value for batchSizeBytes to solve t… by @meng1222 in #1006
• [feat-#994][core] optimize ChunJun serialization for SyncJob by @PaddyMelody in #1004
• Feat chunjun website final by @FlechazoW in #1024
• [hotfix-#1029][redis] Fix Redis Lookup Connector. by @FlechazoW in #1030
• Master doc format by @chestnutqiang in #1031
• [hotfix-816][flinkx-connector-oracle] Fixed Oracle RAW Type Apply To Flink Type is TimeStamp ERROR by @huyongze in #1032
• [Github] Add github template. by @FlechazoW in #1034
• [feat-1039][rocketmq] add rocketmq table source. by @meng1222 in #1040
• [hotfix-#1043][bin] allow user to submit job in local mode by @lvyanquan in #1044
• [hotfix-#1042][chunjun-core] repair pluginRoot‘s folder not set , Cau… by @huaxiapanda in #1045
• [doc-#1046][quickstart]fix standalone command error by @PaddyMelody in #1047
• [hotfix-#1063][kafka] Fix sync Task of kafka throws npe. by @FlechazoW in #1064
• [feat][docker] add document and script about how to build and use doc… by @lvyanquan in #1067
• [readme] Update README.md and add CONTRIBUTING.md by @FlechazoW in #1071
• [Official website] Beautify the homepage and add some components by @FlechazoW in #1073
• [feat][core] add all files under bin directory to chunjun-dist. by @lvyanquan in #1065
• [feat-#1077][base] Optimize the inheritance of 'BaseRichOutputFormat'. by @FlechazoW in #1078
• [feat-#1062][redis] Add source connector and reader connector of redis. by @ll076110 in #1101
• [hotfix-#1103][jdbc] check dbConn valid before write record by @PaddyMelody in #1104
• [hotfix-1097] 修复数据库字段为null时，同步空指针问题 by @KinoMin in #1099
• [CI/CD] Fix ci/cd build error. by @FlechazoW in #1107
• [Feature][pom] Remove the maven plugin of 'git-commit' by @FlechazoW in #1106
• [hotfix-#1052][hive] Fix the data loss problem of HiveWriter by @PaddyMelody in #1053
• [docs][ftp] add ftp docs by @mggger in #1109
• [feature-1084][chunjun-connector-mysqld] MySQL offline synchronizatio… by @KinoMin in #1112
• [hotfix-#1111][redis] Fix keyPrefix verification problem when Lookup … by @ll076110 in #1115
• Quickstart add k8s content by @chenzhuangjia in #1118
• [hotfix-#1119][pgsql] Connection cast-exception when use greenplum sink. by @FlechazoW in #1120
• Feat master hive3 by @chestnutqiang in #1121
• [hotfix-#1124][core] core module git-commit plugin not removed, cause compile and run error. by @chaozwn in #1125
• [hotfix-#1126][client] In local test,class not found com.esotericsoftware.minlog.Log. by @chaozwn in #1127
• [feature-#1058] Add docker development docker-compose file, help quickly build dev environment. by @chaozwn in #1059
• [feat]Refactor hbase to support transformer and fix some bug by @kyo-tom in #1149
• [doc-#1089][docs_zh] how to start a Flink standalone cluster with chunjun dependencies by @lvyanquan in #1169
• [hotfix-#1172][assembly] Rebuild the chunjun-dist.tar.gz file structure by @PaddyMelody in #1173
• add oceanbasecdc connector by @whhe in #1167
• [hotfix-1155][jdbc] support default null, ex:(name string default null) by @mggger in #1170
• [hotfix-#1179][lookup] ChunJun 1.12 dimension table cannot be associated with the latest data by @FlechazoW in #1180
• Feat e2e by @FlechazoW in #1181
• [feat-#1183][assembly] rename install filename by @huaxiapanda in #1184
• [hotfix-simple][#fix-bin]#fix-commit by @conghe2402 in #1187
• [hotfix-none][docs_zh] add CDH integrated document by @conghe2402 in #1189
• [feat-#1193]oracle support nchar、nvarchar2 chinese value by @momisabuilder in #1194
• [hotfix][pom] Add repository of central, sonatype and aliyun. by @FlechazoW in #1192
• [hotfix-#1195]change the code position to support oracle nchar、nvarch… by @momisabuilder in #1196
• [doc-#1200] modify hbase doc about support type by @kyo-tom in #1201
• [hotfix-#1202] JobUtil submit job with ${a} dynamic parameters error. by @chaozwn in #1203
• [feat-#1204][e2e] Add Oracle Logminer E2E Test. by @chaozwn in #1205
• [feat-#1206][e2e] Add E2e Readme.md. by @chaozwn in #1207
• emqx断开不能重连bug修复 by @15656215623 in #1152
• fix bug that lack param of batchSize for Doris Sink config by @baisui1981 in #1213
• [hotfix-1158] fix load hive jdbc dirver dead lock when parll load with mysql jdbc by @mukekein in #1215
• [hotfix-#1212][sqlserver cdc] Fix the npe using sqlserver cdc connector in standalone mode. by @limengyao0809 in #1219
• [feat-e2e]#1220 flink download link is invalid on dockerfile by @yanghuaiGit in #1221
• [hotfix-#1210][ftp] Fix the issue that the connections of SFTP are not released when task failed. by @limengyao0809 in #1222
• [chunjun][elasticsearch7]fix npe errors when column doesn't specified… by @danqiusheng in #1224
• [docs][1056]fix es7 support data type by @fangxy-7010 in #1227
• [hotfix-#1216][kafka] Fix ObjectSizeCalculator only supported on HotS… by @ll076110 in #1230
• [hotfix][clients] avoid unnecessary error message of logfile. by @lvyanquan in #1231
• [docs] fix pluginName of Mysql in MetricPluginConf. by @lvyanquan in #1233
• [docs] update Hyperlink of video about submitting job in Yarn Per-Job mode by @lvyanquan in #1232
• [test-#1238] Add unit test for core by @kyo-tom in #1239
• [feat][starrocks] add starrocks sync/sql connector by @PaddyMelody in #1237
• [feat-#1235][e2e]add emqx container by @mggger in #1236
• [feat][test]add jdbc-base unit test by @PaddyMelody in #1243
• [feat-#1246][rabbitmq] add rabbitmq sql source plugin by @ll076110 in #1247
• [feat-#1244][sybase] add sybase reader plugin by @ll076110 in #1245
• [feat-#1229][emqx]improve connection stability by @mggger in #1234
• [feat-#1251][s3] add s3 reader and writer plugin by @ll076110 in #1252
• [hotfix-#1253][db2] db2 support clob type by @ll076110 in #1254
• [feat-#1249][vertica11] add vertica11 sink plugin by @ll076110 in #1250
• Add Iceberg Connector by @huzk8 in #1242
• [README] Remove expired content. by @FlechazoW in #1257
• [hotfix-#1256][kudu]Fix SQLMode datatype mapping by @PaddyMelody in #1259
• [feat][jdbc] Add keyUtil to handle special columns by @PaddyMelody in #1258
• [hotfix]oracle type modify on sql & adjust to get unique key method by @yanghuaiGit in #1265
• [Release] Release v1.12.6 by @FlechazoW in #1267

New Contributors

• @mggger made their first contribution in #1109
• @whhe made their first contribution in #1167
• @conghe2402 made their first contribution in #1187
• @15656215623 made their first contribution in #1152
• @baisui1981 made their first contribution in #1213
• @mukekein made their first contribution in #1215
• @limengyao0809 made their first contribution in #1219
• @danqiusheng made their first c...

v1.12.5

What's Changed

• [hotfix-842][chunjun-sql] add excluded file of chunjun-ddl-mysql jar by @lvyanquan in #905
• [feat-#903][jdbc]SQL supports the orderByColumn configuration item by @PaddyMelody in #904
• [hotfix-#906][typo]Correct spelling mistakes by @PaddyMelody in #907
• [hotfix-820][binlog] Fixed Canal Parse Exception by @libailin in #828
• [hotfix-#764][jdbc]fix duplicate data occurred when use jdbc polling by @PaddyMelody in #908
• [hotfix-#899][conf] fix config check error by @huyuanfeng2018 in #902
• [hotfix-#913][binlog] Fixed binlog plugin not being able to specify b… by @ll076110 in #917
• [feat-#914][jdbcSplit] jdbc rangeSplitStrategy extension by @PaddyMelody in #915
• [hotfix-#919][jdbc] fix issue of startLocation/endLocation was mistakenly lost by @PaddyMelody in #920
• provided some shell scripts for reducing parameters to submit a job by @lvyanquan in #930
• [hotfix-#926][example]Remove timestamp field in stream.json by @PaddyMelody in #927
• [docfix-DTStack#936][docs] replace kafka-sink's consumerSettings to p… by @huaxiapanda in #937
• [hotfix-#953][session]Fix the session job startup failure by @PaddyMelody in #954
• [hotfix-#960][jdbc] sync mode logminer Delete and Insert Statement instead of Upsert Statement. by @chaozwn in #961
• [hotfix-#969][chunjun-connector-kudu] fixed kudu's type UNIXTIME_MICR… by @huaxiapanda in #970
• [feat-#966][chunjun-assembly] add a module can package a tar.gz install file by @huaxiapanda in #972
• [doc-#975][docs] add some content about how to use install file by @huaxiapanda in #976
• [doc-#978][docs-connector-binlog] update param name 'journal-name' in… by @liumengkai in #984
• [doc-#978][docs-connector-binlog] update other 'journal-name' in text by @liumengkai in #993
• [997] just load archive log when ORA-00310 exception happen by @yanghuaiGit in #998

New Contributors

• @huyuanfeng2018 made their first contribution in #902
• @liumengkai made their first contribution in #984

Full Changelog: v1.12.4...v1.12.5

v1.12.4

What's Changed

• [feat-694][starrocks]add starrocks connector by @libailin in #699
• [hotfix-710][redis] Fix writing to redis in sql mode reports illegal argument exception by @libailin in #715
• Deal the warn if Raw use of parameterized class by @kyo-tom in #738
• [hotfix-647][clickhouse]decimal type supports precision by @PaddyMelody in #741
• [feat-760][oceanbase]support oceanbase mysql tenant connector by @FlechazoW in #761
• [hotfix-772][oceanbase]Fixed Could not found oceanbase clinet depend… by @libailin in #773
• [hotfix-764][flinkx-connector-jdbc-base] Fixed Duplicate data occurred when use jdbc polling ,this commit update notes by @huyongze in #776
• [docs][http] Add http docs. by @FlechazoW in #781
• [hotfix-779][core] Fix parameter of '-p' not taking effect. by @FlechazoW in #782
• [hotfix-744][client] fix directory is not configured NPE by @hendsame in #780
• [hotfix-769][clickhouse] repair bug due to ru.yandex.clickhouse.Click… by @PaddyMelody in #786
• [hotfix-756][kafka] Fix the problem that kafka writer reports NPE whe… by @meng1222 in #763
• [hotfix-788][metric]row size calculator optimize by @PaddyMelody in #791
• [hotfix-793]Fix JDBC Source TypeConverter Error by @KinoMin in #795
• [hotfix-794][core] fix job Configuration item is missing NPE by @hendsame in #798
• [docs-799][connectors] add description of ids for es7-sink by @hendsame in #801
• [hotfix-803][confluent]add kafka-confluent dependency jar by @PaddyMelody in #804
• [feat-818] [restore]add restore module by @yanghuaiGit in #821
• [feat][all]All rename to 'chunjun' by @FlechazoW in #825
• [hotfix-#843][core] Fix Bug of ' ChunJun can not find class of connector. ' by @FlechazoW in #845
• [hotfix-435][jdbc]jdbc numberType contain all numeric type by @PaddyMelody in #848
• [hotfix-853][columnType]add columnType TIMESTAMPZ by @PaddyMelody in #854
• Changed the load format of doris to json. by @meng1222 in #856
• [fix#827][jdbc] jdbc PreparedStmtProxy can't resolve DELETE statement.this is make flink retraction failed. by @chaozwn in #824
• [hotfix-822][stream] Add Stream Connector, print rowData RowKind in first C… by @chaozwn in #823
• Fix NPE when NameMapping is empty. by @meng1222 in #860
• [hotfix-862][local-test] The pom file of module 'local-test' depends on the wrong dependencies of connectors. by @FlechazoW in #863
• [hotfix-864][influxdb] Influxdb convert the wrong value of 'time'. by @FlechazoW in #865
• [hotfix-866][jdbc] password 为空导致的认证失败 by @FlechazoW in #867
• Add flush retry and sleep timeout. by @meng1222 in #871
• [feat-877][hbase]refactory hbase by @yanghuaiGit in #878
• [feat][jdbc] sync data for the value of the splitKey field in the data is NULL by @yanghuaiGit in #879
• [hotfix-880][hdfs]support orc writer when fullcolname size greater than column size by @yanghuaiGit in #881
• [feat][inceptor]Use file reading instead of JDBC by @yanghuaiGit in #883
• [hotfix-884][doris][ftp]print dirty data when dirty type is log for d… by @yanghuaiGit in #886
• postgresql sync support array type. by @meng1222 in #876
• [feat-861][protobuf]add protobuf format by @PaddyMelody in #868
• [hotfix-889][Test] Fix chunjun package failed. by @FlechazoW in #890
• [feat-857][converter]optimize RowSizeCalculator by @PaddyMelody in #891
• [feat-#893][jdbc]range split strategy support all numeric type by @PaddyMelody in #894
• [feat-#846][hdfs]hdfs sql support partitionColumn by @PaddyMelody in #895

New Contributors

• @PaddyMelody made their first contribution in #741
• @huyongze made their first contribution in #776
• @hendsame made their first contribution in #780
• @meng1222 made their first contribution in #763

Full Changelog: v1.12.3...v1.12.4

v1.12.3

Merge Commits From DTStack.

v1.12.2

修复已知bug；
增加inceptor插件和influxdb；

v1.12.1

增加binlog, logminer对ddl数据的处理；
增加doris插件；
插件bugfix；

1.11.0

1、FlinkX升级至1.11
2、删除kafka09插件

1.10.4

1、增加Kingbase插件
2、fix #301
3、fix #276
4、fix #244
5、fix 其他BUG