Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Connector-V2] Support TableSourceFactory/TableSinkFactory on connector #5651

Open
2 tasks done
Hisoka-X opened this issue Oct 18, 2023 · 15 comments
Open
2 tasks done

Comments

@Hisoka-X
Copy link
Member

Hisoka-X commented Oct 18, 2023

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

Purpose

Support TableSourceFactory/TableSinkFactory for connector-v2 source and sink. After #5483 finnished. We should make sure all SeaTunnelSource and SeaTunnelSink created by TableSourceFactory and TableSinkFactory. To achieve the deprecation of Config at the connector level (use ReadonlyConfig for now), the deletion of obsolete prepare methods, the adaptation of CatalogTable feature, etc. Please refer JdbcSourceFactory/JdbcSinkFactory.

Please pick connector you want to implement it!

Source/Sink Connector Contributer Status PR
Source FakeSource Done
Sink Console Done
Sink Assert Done
Source Kafka Done
Sink Kafka Done
Source Http @jackyyyyyssss
Sink Http @jackyyyyyssss
Sink Feishu
Source Socket
Sink Hive @qifanlili
Source Hive @qifanlili
Source Clickhouse @Carl-Zhou-CN
Sink Clickhouse @Carl-Zhou-CN
Sink ClickhouseFile
Source Jdbc Done
Sink Jdbc Done
Source Kudu @Carl-Zhou-CN Done #5789
Sink Kudu @Carl-Zhou-CN Done #5789
Sink EmailSink
Source HdfsFile @dengd1937
Sink HdfsFile @dengd1937
Source LocalFile @ruanwenjun
Sink LocalFile @ruanwenjun Done #5931
Source OssFile
Sink OssFile
Source OssJindoFile
Sink OssJindoFile
Source CosFile
Sink CosFile
Source Pulsar
Source Hudi
Sink DingTalk
Source Elasticsearch @Hisoka-X
Sink Elasticsearch @Hisoka-X
Source IoTDB
Sink IoTDB
Source Neo4j @FuYouJ
Sink Neo4j @FuYouJ
Source FtpFile @Hisoka-X
Sink FtpFile @Hisoka-X
Source SftpFile @Hisoka-X
Sink SftpFile @Hisoka-X
Sink Socket
Source Redis @jackyyyyyssss
Sink Redis @jackyyyyyssss
Sink DataHub
Sink Sentry
Source MongoDB
Sink MongoDB
Source Iceberg
Source InfluxDB @531651225
Source S3File
Sink S3File @chl-wxp
Source AmazonDynamodb
Sink AmazonDynamodb
Source Cassandra
Sink Cassandra
Sink StarRocks Done
Source MyHours
Sink InfluxDB @531651225
Source GoogleSheets
Sink GoogleFirestore
Sink Tablestore
Source Lemlist
Source Klaviyo
Sink Slack
Source OneSignal
Source Jira
Source Gitlab
Source Github
Source Notion
Sink RabbitMQ
Source RabbitMQ
Source OpenMldb
Source SqlServer-CDC Done
Sink Doris @EricJoy2048 #6354
Source Maxcompute
Sink Maxcompute
Source MySQL-CDC Done
Source MongoDB-CDC Done
Sink S3Redshift @chl-wxp
Source TDengine
Sink TDengine
Source Persistiq
Sink SelectDBCloud @ic4y
Sink Hbase
Source StarRocks
Source Rocketmq
Sink Rocketmq
Source Paimon @TaoZex
Sink Paimon @TaoZex

Code of Conduct

@Carl-Zhou-CN
Copy link
Member

Please assign me kudu

@Hisoka-X
Copy link
Member Author

@Carl-Zhou-CN Could you creata a issue for kudu?

@Carl-Zhou-CN
Copy link
Member

@Carl-Zhou-CN Could you creata a issue for kudu?

done

@dengd1937
Copy link
Contributor

dengd1937 commented Oct 26, 2023

Please assign me HdfsFile Source and Sink

@chl-wxp
Copy link
Contributor

chl-wxp commented Oct 27, 2023

Please assign me (S3Redshift sink,S3File sink)

@chl-wxp
Copy link
Contributor

chl-wxp commented Oct 27, 2023

Please assign me (S3Redshift sink,S3File sink)

#5735
#5736

@jackyyyyyssss
Copy link
Contributor

jackyyyyyssss commented Nov 8, 2023

Please assign me http #5807

@jackyyyyyssss
Copy link
Contributor

jackyyyyyssss commented Nov 22, 2023

Please assign me redis #5897

@Carl-Zhou-CN
Copy link
Member

Please assign me Clickhouse, thk

@2606090723
Copy link

目前还没有pgsqlcdc的源吗?Is there no source for pgsqlcdc yet?

@531651225
Copy link
Contributor

Please assign me InfluxDB, thk

@FuYouJ
Copy link
Contributor

FuYouJ commented Jan 18, 2024

Please assign me neo4j and Elastic search

@Hisoka-X
Copy link
Member Author

Please assign me neo4j and Elastic search

Assgined neo4j to you. But ElasticSearch already have a PR #6181

@qifanlili
Copy link

Please assign me Hive,thanks

@TaoZex
Copy link
Contributor

TaoZex commented Jan 18, 2024

Please assgin to me paimon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Todo
Development

No branches or pull requests

10 participants