Movatterモバイル変換

[0]ホーム
URL:

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

 Sign up
Appearance settings

feat: use proto streams to increase maximum module files payload#18268

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to ourterms of service andprivacy statement. We’ll occasionally send you account related emails.

Already on GitHub?Sign in to your account

Merged
Emyrk merged 52 commits intomainfromstevenmasley/4mb
Jun 13, 2025
Merged
Show file tree
Hide file tree
Changes from1 commit
Commits
Show all changes
52 commits
Select commitHold shift + click to select a range
e6b4635
feat: provisioners to stream over modules >4mb limit
EmyrkJun 3, 2025
d115c5a
make gen
EmyrkJun 3, 2025
dea4895
add chunk piece in response
EmyrkJun 3, 2025
b5fceda
rename hash field
EmyrkJun 3, 2025
99d4d54
remove upload type from the chunk
EmyrkJun 3, 2025
e8d8b98
feat: handle uploading data files in runner
EmyrkJun 3, 2025
fbfa08b
chore: implement first part of file streaming
EmyrkJun 4, 2025
73151d1
test adding a stream on the server
EmyrkJun 4, 2025
b61faaf
add completejob stream
EmyrkJun 4, 2025
f547103
change upload behavior
EmyrkJun 4, 2025
bcbf6ca
make gen
EmyrkJun 5, 2025
1bd6b69
upload files independently
EmyrkJun 5, 2025
931ac95
make gen
EmyrkJun 5, 2025
fb8c284
select file by hash
EmyrkJun 5, 2025
6b645d6
fix permissions
EmyrkJun 6, 2025
9dc81db
add log for uploaded files
EmyrkJun 6, 2025
124d366
remove dead file
EmyrkJun 6, 2025
857e88c
ability to omit module file downloads
EmyrkJun 6, 2025
5cf9beb
linting
EmyrkJun 6, 2025
58b2371
linting
EmyrkJun 6, 2025
e880894
make gen
EmyrkJun 6, 2025
31d8e62
fixups
EmyrkJun 6, 2025
bb2000a
linting
EmyrkJun 9, 2025
6633548
linting
EmyrkJun 9, 2025
b070e5a
linting
EmyrkJun 9, 2025
1a70429
add unit tests and fuzz test
EmyrkJun 9, 2025
0f056e8
unit testing
EmyrkJun 9, 2025
1a8c658
comments
EmyrkJun 9, 2025
4ec22d8
fixup test
EmyrkJun 9, 2025
1c9df09
fixup dbmem to return unique files error
EmyrkJun 9, 2025
c30607e
linting
EmyrkJun 9, 2025
0484777
fmt
EmyrkJun 9, 2025
a3cf121
linting
EmyrkJun 9, 2025
3f7707a
linting
EmyrkJun 9, 2025
0ec5d1b
Merge remote-tracking branch 'origin/main' into stevenmasley/4mb
EmyrkJun 10, 2025
e50c8c3
update proto to reuse
EmyrkJun 10, 2025
8cf7f5c
make gen
EmyrkJun 10, 2025
28f83a2
fixup
EmyrkJun 10, 2025
bb3d4ef
test fixup types
EmyrkJun 10, 2025
74073cf
Merge remote-tracking branch 'origin/main' into stevenmasley/4mb
EmyrkJun 11, 2025
c9575c5
add full_hash to complete job
EmyrkJun 11, 2025
6b7e56e
Revert "add full_hash to complete job"
EmyrkJun 11, 2025
24d6227
Reapply "add full_hash to complete job"
EmyrkJun 11, 2025
4f343e6
chore: add hash check of uploaded file after planComplete
EmyrkJun 11, 2025
539755b
bump provider version
EmyrkJun 11, 2025
e4f49ab
linting
EmyrkJun 11, 2025
363498a
nil bytes fail on the typescript
EmyrkJun 11, 2025
02d8563
handle empty slices
EmyrkJun 11, 2025
f1ce0ac
move module max to a constant
EmyrkJun 12, 2025
f6bdf96
add 0 byte file test
EmyrkJun 12, 2025
4f387ec
Merge branch 'main' into stevenmasley/4mb
EmyrkJun 12, 2025
f3525c3
Merge branch 'main' into stevenmasley/4mb
EmyrkJun 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
PrevPrevious commit
NextNext commit
linting
  • Loading branch information
@Emyrk
Emyrk committedJun 9, 2025
commit3f7707aaf40b8a4fd688559153d8b29f1d73be69
6 changes: 3 additions & 3 deletionscoderd/provisionerdserver/upload_file_test.go
View file
Open in desktop
Original file line numberDiff line numberDiff line change
Expand Up@@ -112,7 +112,7 @@ func TestUploadFileErrorScenarios(t *testing.T) {
messages: make(chan *proto.UploadFileRequest, 2),
}

up := &proto.UploadFileRequest{Type: &proto.UploadFileRequest_DataUpload{&proto.DataUpload{
up := &proto.UploadFileRequest{Type: &proto.UploadFileRequest_DataUpload{DataUpload:&proto.DataUpload{
UploadType: proto.DataUploadType(upload.UploadType),
DataHash: upload.DataHash,
FileSize: upload.FileSize,
Expand DownExpand Up@@ -184,7 +184,7 @@ func newMockUploadStream(up *sdkproto.DataUpload, chunks ...*sdkproto.ChunkPiece
messages: make(chan *proto.UploadFileRequest, 1+len(chunks)),
}
if up != nil {
stream.messages <- &proto.UploadFileRequest{Type: &proto.UploadFileRequest_DataUpload{&proto.DataUpload{
stream.messages <- &proto.UploadFileRequest{Type: &proto.UploadFileRequest_DataUpload{DataUpload:&proto.DataUpload{
UploadType: proto.DataUploadType(up.UploadType),
DataHash: up.DataHash,
FileSize: up.FileSize,
Expand All@@ -193,7 +193,7 @@ func newMockUploadStream(up *sdkproto.DataUpload, chunks ...*sdkproto.ChunkPiece
}

for _, chunk := range chunks {
stream.messages <- &proto.UploadFileRequest{Type: &proto.UploadFileRequest_ChunkPiece{&proto.ChunkPiece{
stream.messages <- &proto.UploadFileRequest{Type: &proto.UploadFileRequest_ChunkPiece{ChunkPiece:&proto.ChunkPiece{
Data: chunk.Data,
FullDataHash: chunk.FullDataHash,
PieceIndex: chunk.PieceIndex,
Expand Down
7 changes: 3 additions & 4 deletionsprovisionersdk/proto/dataupload.go
View file
Open in desktop

Some generated files are not rendered by default. Learn more abouthow customized files appear on GitHub.

Loading
[8]ページ先頭
©2009-2025 Movatter.jp