Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [zeta] The mission is stuck. It doesn't stop #8368

Open
2 of 3 tasks
LeonYoah opened this issue Dec 24, 2024 · 3 comments
Open
2 of 3 tasks

[Bug] [zeta] The mission is stuck. It doesn't stop #8368

LeonYoah opened this issue Dec 24, 2024 · 3 comments
Assignees
Labels

Comments

@LeonYoah
Copy link
Contributor

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Normally, an error should be reported to stop the task. However, when the task is scheduled through the scheduling platform, it occasionally shows that reading 0 and writing 0 all the time, and it does not stop. After the actual operation has been running for more than 7 hours, I find that the state is running through the interface.:
81dbcbdba7a6e0137eba7eade7ee9c5
202412241025-seatunnel-jstack.zip

SeaTunnel Version

2.3.7

SeaTunnel Config

env {
  execution.parallelism = 1
  job.mode = "BATCH"
}

source {
  Http {
    result_table_name = "http"
    url = "https://xxx/2detail"
    method = "GET"
    params = {
      id = "[xxxx]"
      typeCode = "[xxx]"
    }
    params_parsing_arrays=[id,typeCode]
    params_add = true
    params_path = "$"
    skip_ssl_verification = true
    format = "json"
          json_field = {
              ID="$.params_id"
              UNIT_NAME="$.unitName"
              TYPE_CODE="$.typeCode"
              DATE_TIME="$.dateTime"
              TYPE="$.type"
              PROBER_NAME="$.proberName"
              PROBER_TYPE="$.proberType"
              PROBER_TYPE_NAME="$.proberTypeName"
              INSTALLATION_LOCATION="$.installationLocation"
              RANGE_UP="$.rangeUp"
              RANGE_DOWN="$.rangeDown"
    }
    schema = {
      fields {
        ID = string
        UNIT_NAME = string
        TYPE_CODE = string
        PROBER_NAME = string
        DATE_TIME = string
        TYPE = string
        PROBER_TYPE = string
        PROBER_TYPE_NAME = string
        INSTALLATION_LOCATION = string
        RANGE_UP = string
        RANGE_DOWN = string
      }
    }
  }
}
    transform {
  Sql {
query = "select ID,UNIT_NAME,TYPE_CODE,PROBER_NAME,DATE_TIME,TYPE,PROBER_TYPE,PROBER_TYPE_NAME,INSTALLATION_LOCATION,RANGE_UP,RANGE_DOWN,now() as CREATE_TIME,now() as UPDATE_TIME from http"
}
  }
sink {
    MappingJdbc {
        url = "jdbc:xugu://xxx/xxx"
        driver = "com.xugu.cloudjdbc.Driver"
        user = "xxx"
        password = "xxx"
        generate_sink_sql = true
        database = xxx
        table = xxx.xxx
    	enable_upsert = true
        primary_keys = [ID]	
    	batch_size = 400
	}
}

Running Command

./seatunnel.sh --config job/aa.txt

Error Exception

Zeta or Flink or Spark Version

zeta

Java or Scala Version

java8

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@LeonYoah LeonYoah added the bug label Dec 24, 2024
@hailin0
Copy link
Member

hailin0 commented Dec 24, 2024

cc @Hisoka-X

@Hisoka-X Hisoka-X self-assigned this Dec 24, 2024
@VincentSleepless
Copy link

也遇到了同样的场景,集群作业大量状态无法更新,资源释放和申请互相parking。。。。

@VincentSleepless
Copy link

@hailin0 @Hisoka-X

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

4 participants