Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test(connector): test postgres source and sink recovery #16765

Draft
wants to merge 8 commits into
base: main
Choose a base branch
from

Conversation

kwannoel
Copy link
Contributor

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

Looks like if we do a series of recovery, CN segfaults.

In production I suppose we will apply recovery. But CN should not segfault in the first place.

CN log:

 thread="rw-dbz-engine-runner-12006" class="org.apache.kafka.connect.json.JsonConverterConfig"
2024-05-15T15:03:17.084739+08:00  INFO risingwave_connector_node: JDBC connection: autoCommit = false, trxn = 2 thread="Thread-107" class="com.risingwave.connector.JDBCSink"
2024-05-15T15:03:17.084629+08:00  INFO risingwave_connector_node: JDBC connection: autoCommit = false, trxn = 2 thread="Thread-109" class="com.risingwave.connector.JDBCSink"
2024-05-15T15:03:17.0849+08:00  INFO risingwave_jni_core: send error error=channel closed
2024-05-15T15:03:17.084957+08:00  INFO risingwave_jni_core: send error error=channel closed
2024-05-15T15:03:17.084977+08:00 ERROR risingwave_connector_node: sink writer error: : io.grpc.StatusRuntimeException: INTERNAL: unable to send response
	at io.grpc.Status.asRuntimeException(Status.java:530)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:38)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:24)
	at com.risingwave.connector.SinkWriterStreamObserver.onNext(SinkWriterStreamObserver.java:108)
	at com.risingwave.connector.JniSinkWriterHandler.runJniSinkWriterThread(JniSinkWriterHandler.java:40)
 thread="Thread-107" class="com.risingwave.connector.SinkWriterStreamObserver"
2024-05-15T15:03:17.085013+08:00 ERROR risingwave_connector_node: sink writer error: : io.grpc.StatusRuntimeException: INTERNAL: unable to send response
	at io.grpc.Status.asRuntimeException(Status.java:530)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:38)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:24)
	at com.risingwave.connector.SinkWriterStreamObserver.onNext(SinkWriterStreamObserver.java:108)
	at com.risingwave.connector.JniSinkWriterHandler.runJniSinkWriterThread(JniSinkWriterHandler.java:40)
 thread="Thread-109" class="com.risingwave.connector.SinkWriterStreamObserver"
2024-05-15T15:03:17.085115+08:00 ERROR risingwave_connector_node: JniSinkWriterHandler onError: : io.grpc.StatusRuntimeException: INTERNAL: unable to send response
	at io.grpc.Status.asRuntimeException(Status.java:530)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:38)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:24)
	at com.risingwave.connector.SinkWriterStreamObserver.onNext(SinkWriterStreamObserver.java:108)
	at com.risingwave.connector.JniSinkWriterHandler.runJniSinkWriterThread(JniSinkWriterHandler.java:40)
 thread="Thread-109" class="com.risingwave.connector.JniSinkWriterResponseObserver"
2024-05-15T15:03:17.085118+08:00 ERROR risingwave_connector_node: JniSinkWriterHandler onError: : io.grpc.StatusRuntimeException: INTERNAL: unable to send response
	at io.grpc.Status.asRuntimeException(Status.java:530)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:38)
	at com.risingwave.connector.JniSinkWriterResponseObserver.onNext(JniSinkWriterResponseObserver.java:24)
	at com.risingwave.connector.SinkWriterStreamObserver.onNext(SinkWriterStreamObserver.java:108)
	at com.risingwave.connector.JniSinkWriterHandler.runJniSinkWriterThread(JniSinkWriterHandler.java:40)
 thread="Thread-107" class="com.risingwave.connector.JniSinkWriterResponseObserver"
2024-05-15T15:03:17.085252+08:00  INFO risingwave_connector_node: Flush offsets successfully, partition: {server=RW_CDC_12006}, offsets: {transaction_id=null, lsn_proc=880235920, messageType=INSERT, lsn_commit=880212792, lsn=880235920, txId=18364, ts_usec=1715756590666573} thread="rw-dbz-engine-runner-12006" class="com.risingwave.connector.cdc.debezium.internal.ConfigurableOffsetBackingStore"
2024-05-15T15:03:17.086192+08:00  INFO risingwave_connector_node: Starting PostgresConnectorTask with configuration: thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086316+08:00  INFO risingwave_connector_node:    connector.class = io.debezium.connector.postgresql.PostgresConnector thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086337+08:00  INFO risingwave_connector_node:    max.queue.size = 8192 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086356+08:00  INFO risingwave_connector_node:    slot.name = rw_cdc_c5a911bb95c644e9aade60ac976e5063 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086376+08:00  INFO risingwave_connector_node:    publication.name = rw_publication thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086395+08:00  INFO risingwave_connector_node:    topic.heartbeat.prefix = RW_CDC_HeartBeat_ thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086413+08:00  INFO risingwave_connector_node:    provide.transaction.metadata = false thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086432+08:00  INFO risingwave_connector_node:    topic.prefix = RW_CDC_12006 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.08645+08:00  INFO risingwave_connector_node:    decimal.handling.mode = string thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086468+08:00  INFO risingwave_connector_node:    offset.storage.file.filename =  thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086487+08:00  INFO risingwave_connector_node:    interval.handling.mode = string thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086505+08:00  INFO risingwave_connector_node:    converters = datetime thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086523+08:00  INFO risingwave_connector_node:    errors.retry.delay.initial.ms = 300 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086542+08:00  INFO risingwave_connector_node:    datetime.type = com.risingwave.connector.cdc.debezium.converters.DatetimeTypeConverter thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.08656+08:00  INFO risingwave_connector_node:    value.converter = org.apache.kafka.connect.json.JsonConverter thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086579+08:00  INFO risingwave_connector_node:    key.converter = org.apache.kafka.connect.json.JsonConverter thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086597+08:00  INFO risingwave_connector_node:    publication.autocreate.mode = disabled thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086616+08:00  INFO risingwave_connector_node:    database.user = test thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086641+08:00  INFO risingwave_connector_node:    database.dbname = test thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.08666+08:00  INFO risingwave_connector_node:    offset.storage = com.risingwave.connector.cdc.debezium.internal.ConfigurableOffsetBackingStore thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086679+08:00  INFO risingwave_connector_node:    time.precision.mode = connect thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086697+08:00  INFO risingwave_connector_node:    offset.flush.timeout.ms = 5000 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086715+08:00  INFO risingwave_connector_node:    errors.retry.delay.max.ms = 10000 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086733+08:00  INFO risingwave_connector_node:    heartbeat.interval.ms = 300000 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086753+08:00  INFO risingwave_connector_node:    offset.storage.risingwave.state.value = {"sourcePartition":{"server":"RW_CDC_12006"},"sourceOffset":{"transaction_id":null,"lsn_proc":880235920,"messageType":"INSERT","lsn_commit":880212792,"lsn":880235920,"txId":18364,"ts_usec":1715756590666573},"isHeartbeat":false} thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086772+08:00  INFO risingwave_connector_node:    plugin.name = pgoutput thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086793+08:00  INFO risingwave_connector_node:    database.port = 5432 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086811+08:00  INFO risingwave_connector_node:    offset.flush.interval.ms = 60000 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086829+08:00  INFO risingwave_connector_node:    schema.history.internal = io.debezium.relational.history.MemorySchemaHistory thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086848+08:00  INFO risingwave_connector_node:    errors.max.retries = -1 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086875+08:00  INFO risingwave_connector_node:    database.hostname = localhost thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086894+08:00  INFO risingwave_connector_node:    database.password = ******** thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086913+08:00  INFO risingwave_connector_node:    name = localhost:5432:test.public.t thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086931+08:00  INFO risingwave_connector_node:    debezium.embedded.shutdown.pause.before.interrupt.ms = 1 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.08695+08:00  INFO risingwave_connector_node:    max.batch.size = 1024 thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086968+08:00  INFO risingwave_connector_node:    table.include.list = public.t thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.086986+08:00  INFO risingwave_connector_node:    snapshot.mode = never thread="rw-dbz-engine-runner-12006" class="io.debezium.connector.common.BaseSourceTask"
2024-05-15T15:03:17.08704+08:00  INFO risingwave_connector_node: Loading the custom source info struct maker plugin: io.debezium.connector.postgresql.PostgresSourceInfoStructMaker thread="rw-dbz-engine-runner-12006" class="io.debezium.config.CommonConnectorConfig"
2024-05-15T15:03:17.087323+08:00  INFO risingwave_connector_node: Loading the custom topic naming strategy plugin: io.debezium.schema.SchemaTopicNamingStrategy thread="rw-dbz-engine-runner-12006" class="io.debezium.config.CommonConnectorConfig"
2024-05-15T15:03:17.09449+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12005, instance_id: 133
2024-05-15T15:03:17.09507+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12007, instance_id: 134
2024-05-15T15:03:17.095509+08:00 DEBUG risingwave_stream::from_proto::row_id_gen: row id gen executor: Some(1111111111111111111111111111111111111111111111111111111111111111000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)
2024-05-15T15:03:17.095719+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 135
2024-05-15T15:03:17.096083+08:00 DEBUG risingwave_stream::from_proto::row_id_gen: row id gen executor: Some(0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000011111111111111111111111111111111111111111111111111111111111111110000000000000000000000000000000000000000000000000000000000000000)
2024-05-15T15:03:17.096515+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 136
2024-05-15T15:03:17.097443+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12004, instance_id: 137
2024-05-15T15:03:17.097706+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 138
2024-05-15T15:03:17.098114+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12007, instance_id: 139
2024-05-15T15:03:17.098496+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12007, instance_id: 140
2024-05-15T15:03:17.098786+08:00 DEBUG risingwave_stream::from_proto::row_id_gen: row id gen executor: Some(0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001111111111111111111111111111111111111111111111111111111111111111)
2024-05-15T15:03:17.099265+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 141
2024-05-15T15:03:17.100326+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12004, instance_id: 142
2024-05-15T15:03:17.100524+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 143
2024-05-15T15:03:17.100834+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12007, instance_id: 144
2024-05-15T15:03:17.101348+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12004, instance_id: 145
2024-05-15T15:03:17.101485+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 146
2024-05-15T15:03:17.101775+08:00 DEBUG risingwave_stream::from_proto::row_id_gen: row id gen executor: Some(0000000000000000000000000000000000000000000000000000000000000000111111111111111111111111111111111111111111111111111111111111111100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)
2024-05-15T15:03:17.102029+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 147
2024-05-15T15:03:17.102569+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12005, instance_id: 148
2024-05-15T15:03:17.102933+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12005, instance_id: 149
2024-05-15T15:03:17.103184+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12005, instance_id: 150
2024-05-15T15:03:17.104021+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12004, instance_id: 151
2024-05-15T15:03:17.104255+08:00 DEBUG risingwave_storage::hummock::event_handler::hummock_event_handler: new read version registered: table_id: 12001, instance_id: 152
2024-05-15T15:03:17.105404+08:00 DEBUG actor{otel.name="Actor 12013" actor_id=12013}:executor{otel.name="StreamScan 2EED0000272A"}: risingwave_stream::executor::backfill::arrangement_backfill: Arrangement Backfill Executor started
2024-05-15T15:03:17.105527+08:00 DEBUG actor{otel.name="Actor 12015" actor_id=12015}:executor{otel.name="StreamScan 2EEF0000272A"}: risingwave_stream::executor::backfill::arrangement_backfill: Arrangement Backfill Executor started
2024-05-15T15:03:17.105609+08:00 DEBUG actor{otel.name="Actor 12016" actor_id=12016}:executor{otel.name="StreamScan 2EF00000272A"}: risingwave_stream::executor::backfill::arrangement_backfill: Arrangement Backfill Executor started
2024-05-15T15:03:17.106057+08:00 DEBUG actor{otel.name="Actor 12014" actor_id=12014}:executor{otel.name="StreamScan 2EEE0000272A"}: risingwave_stream::executor::backfill::arrangement_backfill: Arrangement Backfill Executor started
2024-05-15T15:03:17.107544+08:00 DEBUG actor{otel.name="Actor 12021" actor_id=12021}:executor{otel.name="Source 2EF500002716"}: risingwave_stream::executor::source::source_executor: source exector: actor 12021 boot with splits: []
2024-05-15T15:03:17.107544+08:00 DEBUG actor{otel.name="Actor 12024" actor_id=12024}:executor{otel.name="Source 2EF800002716"}: risingwave_stream::executor::source::source_executor: source exector: actor 12024 boot with splits: [PostgresCdc(DebeziumCdcSplit { mysql_split: None, postgres_split: Some(PostgresCdcSplit { inner: CdcSplitBase { split_id: 12006, start_offset: None, snapshot_done: false }, server_addr: None }), citus_split: None, mongodb_split: None, _phantom: PhantomData<risingwave_connector::source::cdc::Postgres> })]
2024-05-15T15:03:17.107587+08:00 DEBUG actor{otel.name="Actor 12021" actor_id=12021}:executor{otel.name="Source 2EF500002716"}: risingwave_stream::executor::source::source_executor: start with state state=None
2024-05-15T15:03:17.107777+08:00 DEBUG risingwave_stream::executor::source::source_executor: wait epoch worker start success
2024-05-15T15:03:17.107813+08:00 DEBUG actor{otel.name="Actor 12022" actor_id=12022}:executor{otel.name="Source 2EF600002716"}: risingwave_stream::executor::source::source_executor: source exector: actor 12022 boot with splits: []
2024-05-15T15:03:17.107824+08:00 DEBUG actor{otel.name="Actor 12024" actor_id=12024}:executor{otel.name="Source 2EF800002716"}: risingwave_stream::executor::source::source_executor: start with state state=Some([PostgresCdc(DebeziumCdcSplit { mysql_split: None, postgres_split: Some(PostgresCdcSplit { inner: CdcSplitBase { split_id: 12006, start_offset: Some("{\"sourcePartition\":{\"server\":\"RW_CDC_12006\"},\"sourceOffset\":{\"transaction_id\":null,\"lsn_proc\":880235920,\"messageType\":\"INSERT\",\"lsn_commit\":880212792,\"lsn\":880235920,\"txId\":18364,\"ts_usec\":1715756590666573},\"isHeartbeat\":false}"), snapshot_done: true }, server_addr: None }), citus_split: None, mongodb_split: None, _phantom: PhantomData<risingwave_connector::source::cdc::Postgres> })])
2024-05-15T15:03:17.107854+08:00 DEBUG actor{otel.name="Actor 12022" actor_id=12022}:executor{otel.name="Source 2EF600002716"}: risingwave_stream::executor::source::source_executor: start with state state=None
2024-05-15T15:03:17.107876+08:00 DEBUG actor{otel.name="Actor 12024" actor_id=12024}:executor{otel.name="Source 2EF800002716"}: risingwave_connector::source::reader::reader: spawning connector split reader splits=[PostgresCdc(DebeziumCdcSplit { mysql_split: None, postgres_split: Some(PostgresCdcSplit { inner: CdcSplitBase { split_id: 12006, start_offset: Some("{\"sourcePartition\":{\"server\":\"RW_CDC_12006\"},\"sourceOffset\":{\"transaction_id\":null,\"lsn_proc\":880235920,\"messageType\":\"INSERT\",\"lsn_commit\":880212792,\"lsn\":880235920,\"txId\":18364,\"ts_usec\":1715756590666573},\"isHeartbeat\":false}"), snapshot_done: true }, server_addr: None }), citus_split: None, mongodb_split: None, _phantom: PhantomData<risingwave_connector::source::cdc::Postgres> })] prop=CdcProperties { properties: {"password": "connector", "hostname": "localhost", "slot.name": "rw_cdc_c5a911bb95c644e9aade60ac976e5063", "schema.name": "public", "database.name": "test", "publication.create.enable": "true", "table.name": "t", "publication.name": "rw_publication", "port": "5432", "username": "test"}, table_schema: TableSchema { columns: [], pk_indices: [] }, is_cdc_source_job: false, is_backfill_table: false, _phantom: PhantomData<risingwave_connector::source::cdc::Postgres> }
2024-05-15T15:03:17.108016+08:00 DEBUG risingwave_stream::executor::source::source_executor: wait epoch worker start success
2024-05-15T15:03:17.108035+08:00 DEBUG risingwave_stream::executor::source::source_executor: wait epoch worker start success
2024-05-15T15:03:17.108073+08:00 DEBUG actor{otel.name="Actor 12023" actor_id=12023}:executor{otel.name="Source 2EF700002716"}: risingwave_stream::executor::source::source_executor: source exector: actor 12023 boot with splits: []
2024-05-15T15:03:17.108094+08:00 DEBUG actor{otel.name="Actor 12023" actor_id=12023}:executor{otel.name="Source 2EF700002716"}: risingwave_stream::executor::source::source_executor: start with state state=None
2024-05-15T15:03:17.108427+08:00 DEBUG risingwave_stream::executor::source::source_executor: wait epoch worker start success
2024-05-15T15:03:17.108671+08:00 DEBUG jni::wrapper::java_vm::vm: Attached thread  (ThreadId(76)). 5 threads attached    
2024-05-15T15:03:17.114316+08:00 DEBUG jni::wrapper::java_vm::vm: Attached thread  (ThreadId(77)). 6 threads attached    
2024-05-15T15:03:17.115284+08:00 DEBUG jni::wrapper::java_vm::vm: Attached thread  (ThreadId(78)). 7 threads attached    
2024-05-15T15:03:17.11618+08:00 DEBUG jni::wrapper::java_vm::vm: Attached thread  (ThreadId(79)). 8 threads attached    
2024-05-15T15:03:17.120874+08:00 DEBUG jni::wrapper::java_vm::vm: Attached thread  (ThreadId(80)). 9 threads attached    
Wed May 15 07:03:17 UTC 2024 [risedev]: Program exited with 139

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • I have added test labels as necessary. See details.
  • I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features Sqlsmith: Sql feature generation #7934).
  • My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
  • All checks passed in ./risedev check (or alias, ./risedev c)
  • My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)
  • My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

  • My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note

If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.


sleep 10s

query I
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is where it fails, because at this point the CN has segfaulted, and we can't run queries.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't find the ci pipeline you run the test.

Wed May 15 07:03:17 UTC 2024 [risedev]: Program exited with 139

Probably you are using openjdk 11 in your mac, please use java 17

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just ran it locally.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay let me try it with java 17.

@kwannoel kwannoel requested a review from StrikeW May 15, 2024 07:12
Copy link

gitguardian bot commented May 15, 2024

⚠️ GitGuardian has uncovered 10 secrets following the scan of your pull request.

Please consider investigating the findings and remediating the incidents. Failure to do so may lead to compromising the associated services or software components.

🔎 Detected hardcoded secrets in your pull request
GitGuardian id GitGuardian status Secret Commit Filename
9425213 Triggered Generic Password 70c5e94 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 70c5e94 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 70c5e94 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 70c5e94 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 9172c38 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 9172c38 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 9172c38 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 0313c75 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 0f03c93 e2e_test/sink/recovery/pg.slt View secret
9425213 Triggered Generic Password 5c6627c e2e_test/sink/recovery/pg.slt View secret
🛠 Guidelines to remediate hardcoded secrets
  1. Understand the implications of revoking this secret by investigating where it is used in your code.
  2. Replace and store your secrets safely. Learn here the best practices.
  3. Revoke and rotate these secrets.
  4. If possible, rewrite git history. Rewriting git history is not a trivial act. You might completely break other contributing developers' workflow and you risk accidentally deleting legitimate data.

To avoid such incidents in the future consider


🦉 GitGuardian detects secrets in your source code to help developers and security teams secure the modern development process. You are seeing this because you or someone else with access to this repository has authorized GitGuardian to scan your pull request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants