Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ParseError "2262-04-13T00:00:00+00:00 would overflow 64-bit signed nanoseconds" #695

Open
CyrosX opened this issue Jul 29, 2024 · 1 comment

Comments

@CyrosX
Copy link

CyrosX commented Jul 29, 2024

I've got a problem with an overflowing timestamps. I'm consuming messages stored in my Kafka with some fake content. The date goes very far into the future (transactionDate). transactionDate's are for example: "2010-05-14" without time.
At some point the execution of the pipeline fails and in the error log is "Deserialization error ParseError "2262-04-13T00:00:00+00:00 would overflow 64-bit signed nanoseconds"" shown.
What can I do to solve this 🤔

CREATE TABLE kafka
(
    amount  int,
    transactionDate TIMESTAMP,
    event_time    TIMESTAMP GENERATED ALWAYS AS (CAST("transactionDate" as TIMESTAMP)) STORED,
    watermark     TIMESTAMP GENERATED ALWAYS AS (CAST("transactionDate" as TIMESTAMP)) STORED
) WITH (
      connector = 'kafka',
      format = 'json',
      bootstrap_servers = 'broker:29092',
      topic = 'in',
      type = 'source',
      'source.offset' = 'earliest',
      'source.read_mode' = 'read_committed',
      event_time_field = 'event_time',
      watermark_field = 'watermark'
      );
@TwistingTwists
Copy link

Are you sure you want to schedule something for the date 2262-04-13 ? that does sound a little overstretch

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants