Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Consider open source data sharing endpoint?#9035

ZhiHanZ started this conversation inIdeas
Discussion options

Currently we have already supported data sharing.https://databend.rs/doc/sql-commands/ddl/share/ , thus far we have designed our data sharing protocol with simple RESTful api and allow user to query accross different tenant under fine-grained permissions.
I think it is the right timing to implement an open source sharing endpoint.

Supposed feature:

  1. A simple server for sharing operator testing and debugging
  2. A lambda-runtime release for serverless deployment
  3. Written in rust, thus we could use it with opendal(https://github.com/datafuselabs/opendal) for much easier maintainence on sharing endpoint

Possible features:

  1. also support delta-sharing and other data lake sharing protocols on a single sharing endpoint
  2. support more runtimes such as cloudflare worker
You must be logged in to vote

Replies: 2 comments 2 replies

Comment options

cc@BohuTANG PTAL

You must be logged in to vote
0 replies
Comment options

maybe we can consider extending the DDL about sharing like this:

CREATE DATABASE xxx FROM SHARING 'https://mytoken:password@my-sharing-endpoint.intra.com'

so we can allow the sharing server be deployed in an on-premise environment.

You must be logged in to vote
2 replies
@ZhiHanZ
Comment options

I think it could provide additional configurations such as

  1. overriding defaulting sharing endpoint
  2. support customized authentication
  3. support private deployed databend-query clusters to share data

maybe we could at first promote some SQL DDL API RFC and make further discussions?

@BohuTANG
Comment options

Share endpoint can be a catalog?

Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment
Category
Ideas
Labels
None yet
3 participants
@ZhiHanZ@flaneur2020@BohuTANG

[8]ページ先頭

©2009-2025 Movatter.jp