- Notifications
You must be signed in to change notification settings - Fork767
-
I see that there is a general purpose way to share buffer memory from python to C# I'm assuming that works great for numpy, pandas, and lots of other things. Is this also suitable to Apache Arrow tables? Should we expect the Apache Arrow libraries to give us a specialized and ideomatic option, considering the fact that Arrow it is built for exchanging data and there are native implementations for just about every programming language. Any tips would be appreciated. |
BetaWas this translation helpful?Give feedback.
All reactions
Replies: 1 comment
-
yeah in the pythonnet context Arrow still makes more sense than pushing everything through PyBuffer. arrow is basically built for this exact problem:
typical setup with pythonnet:
this integrates cleanly with pythonnet and avoids abusing the buffer protocol. If you really need true zero-copy, Arrow C Data Interface can be used from pythonnet too, but lifetime management becomes tricky (Python GC, ownership rules, etc). For most cases IPC is simpler and safe. so overall:
|
BetaWas this translation helpful?Give feedback.