Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [Doris] 从Doris表中同步数据时datetime类型读取错误 #8352

Open
2 of 3 tasks
exitNA opened this issue Dec 20, 2024 · 3 comments
Open
2 of 3 tasks

[Bug] [Doris] 从Doris表中同步数据时datetime类型读取错误 #8352

exitNA opened this issue Dec 20, 2024 · 3 comments

Comments

@exitNA
Copy link

exitNA commented Dec 20, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

batch模式从doris中同步数据到console中,读取datetime类型数据错误。

doris表结构:

CREATE TABLE `test_sync` (
  `id` int NULL,
  `dt` datetime NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP
) ENGINE=OLAP
UNIQUE KEY(`id`)
DISTRIBUTED BY HASH(`id`) BUCKETS 2
PROPERTIES (
"storage_format" = "V2",
"inverted_index_storage_format" = "V1",
"enable_unique_key_merge_on_write" = "true"
);

数据如下:

id dt
1 2024-12-03 10:20:32

seatunnel任务打印结果是:

2024-12-20 19:39:16,193 INFO  [.a.s.c.s.c.s.ConsoleSinkWriter] [st-multi-table-sink-writer-1] - subtaskIndex=0  rowIndex=1:  SeaTunnelRow#tableId= SeaTunnelRow#kind=INSERT : 1, 1970-01-01T00:28:53.192432

seatunnel将2024-12-03 10:20:32读成了1970-01-01T00:28:53.192432

doris 版本: 2.1.7

SeaTunnel Version

2.3.8

SeaTunnel Config

env {
  job.name = "doris-mysql"
  job.mode = "BATCH"
}

source {
Doris {
    fenodes = "${doris_fe}"
    username = "***"
    password = "***"
    database = "test"
    table = "test_sync"
}
}

transform {
}

sink {
Console {}
}

Running Command

./bin/seatunnel.sh -c job/doris-mysql.config -m local

Error Exception

no exception

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@exitNA exitNA added the bug label Dec 20, 2024
@yunxiaoyang01
Copy link

我也遇到了同样的问题。doris的版本是2.1.7.SeaTunnel Version 是 自己拉的dev分支打的包

Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Jan 20, 2025
@levisLi
Copy link

levisLi commented Mar 3, 2025

我也遇到了,官方对bug的维护有点慢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants