proto
packageThis package is not in the latest version of its module.
Details
Validgo.mod file
The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license
Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version
Modules with tagged versions give importers more predictable builds.
Stable version
When a project reaches major version v1 it is considered stable.
- Learn more about best practices
Repository
Links
Documentation¶
Overview¶
Package proto provides functions operating on protocol buffer messages.
For documentation on protocol buffers in general, see:https://protobuf.dev.
For a tutorial on using protocol buffers with Go, see:https://protobuf.dev/getting-started/gotutorial.
For a guide to generated Go protocol buffer code, see:https://protobuf.dev/reference/go/go-generated.
Binary serialization¶
This package contains functions to convert to and from the wire format,an efficient binary serialization of protocol buffers.
Size reports the size of a message in the wire format.
Marshal converts a message to the wire format.TheMarshalOptions type provides more control over wire marshaling.
Unmarshal converts a message from the wire format.TheUnmarshalOptions type provides more control over wire unmarshaling.
Basic message operations¶
Clone makes a deep copy of a message.
Merge merges the content of a message into another.
Equal compares two messages. For more control over comparisonsand detailed reporting of differences, see packagegoogle.golang.org/protobuf/testing/protocmp.
Reset clears the content of a message.
CheckInitialized reports whether all required fields in a message are set.
Optional scalar constructors¶
The API for some generated messages represents optional scalar fieldsas pointers to a value. For example, an optional string field has theGo type *string.
- Bool,Int32,Int64,Uint32,Uint64,Float32,Float64, andStringtake a value and return a pointer to a new instance of it,to simplify construction of optional field values.
Generated enum types usually have an Enum method which performs thesame operation.
Optional scalar fields are only supported in proto2.
Extension accessors¶
- HasExtension,GetExtension,SetExtension, andClearExtensionaccess extension field values in a protocol buffer message.
Extension fields are only supported in proto2.
Related packages¶
Packagegoogle.golang.org/protobuf/encoding/protojson converts messages toand from JSON.
Packagegoogle.golang.org/protobuf/encoding/prototext converts messages toand from the text format.
Packagegoogle.golang.org/protobuf/reflect/protoreflect provides areflection interface for protocol buffer data types.
Packagegoogle.golang.org/protobuf/testing/protocmp provides featuresto compare protocol buffer messages with thegithub.com/google/go-cmp/cmppackage.
Packagegoogle.golang.org/protobuf/types/dynamicpb provides a dynamicmessage type, suitable for working with messages where the protocol buffertype is only known at runtime.
This module contains additional packages for more specialized use cases.Consult the individual package documentation for details.
Index¶
- Variables
- func Bool(v bool) *bool
- func CheckInitialized(m Message) error
- func ClearExtension(m Message, xt protoreflect.ExtensionType)
- func CloneOf[M Message](m M) M
- func Equal(x, y Message) bool
- func Float32(v float32) *float32
- func Float64(v float64) *float64
- func GetExtension(m Message, xt protoreflect.ExtensionType) any
- func HasExtension(m Message, xt protoreflect.ExtensionType) bool
- func Int32(v int32) *int32
- func Int64(v int64) *int64
- func Marshal(m Message) ([]byte, error)
- func Merge(dst, src Message)
- func MessageName(m Message) protoreflect.FullName
- func RangeExtensions(m Message, f func(protoreflect.ExtensionType, any) bool)
- func Reset(m Message)
- func SetExtension(m Message, xt protoreflect.ExtensionType, v any)
- func Size(m Message) int
- func String(v string) *string
- func Uint32(v uint32) *uint32
- func Uint64(v uint64) *uint64
- func Unmarshal(b []byte, m Message) error
- func ValueOrDefault[T interface{ ... }, P any](val T) T
- func ValueOrDefaultBytes(val []byte) []byte
- func ValueOrNil[T any](has bool, getter func() T) *T
- type MarshalOptions
- type Message
- type UnmarshalOptions
Examples¶
Constants¶
This section is empty.
Variables¶
var ErrorerrorError matches all errors produced by packages in the protobuf moduleaccording toerrors.Is.
Example usage:
if errors.Is(err, proto.Error) { ... }Functions¶
funcCheckInitialized¶
CheckInitialized returns an error if any required fields in m are not set.
funcClearExtension¶
func ClearExtension(mMessage, xtprotoreflect.ExtensionType)
ClearExtension clears an extension field such that subsequentHasExtension calls return false.It panics if m is invalid or if xt does not extend m.
funcCloneOf¶added inv1.36.6
func CloneOf[MMessage](m M) M
CloneOf returns a deep copy of m. If the top-level message is invalid,it returns an invalid message as well.
funcEqual¶
Equal reports whether two messages are equal,by recursively comparing the fields of the message.
Bytes fields are equal if they contain identical bytes.Empty bytes (regardless of nil-ness) are considered equal.
Floating-point fields are equal if they contain the same value.Unlike the == operator, a NaN is equal to another NaN.
Other scalar fields are equal if they contain the same value.
Message fields are equal if they havethe same set of populated known and extension field values, andthe same set of unknown fields values.
Lists are equal if they are the same length andeach corresponding element is equal.
Maps are equal if they have the same set of keys andthe corresponding value for each key is equal.
An invalid message is not equal to a valid message.An invalid message is only equal to another invalid message of thesame type. An invalid message often corresponds to a nil pointerof the concrete message type. For example, (*pb.M)(nil) is not equalto &pb.M{}.If two valid messages marshal to the same bytes under deterministicserialization, then Equal is guaranteed to report true.
funcGetExtension¶
func GetExtension(mMessage, xtprotoreflect.ExtensionType)any
GetExtension retrieves the value for an extension field.If the field is unpopulated, it returns the default value forscalars and an immutable, empty value for lists or messages.It panics if xt does not extend m.
The type of the value is dependent on the field type of the extension.For extensions generated by protoc-gen-go, the Go type is as follows:
╔═══════════════════╤═════════════════════════╗║ Go type │ Protobuf kind ║╠═══════════════════╪═════════════════════════╣║ bool │ bool ║║ int32 │ int32, sint32, sfixed32 ║║ int64 │ int64, sint64, sfixed64 ║║ uint32 │ uint32, fixed32 ║║ uint64 │ uint64, fixed64 ║║ float32 │ float ║║ float64 │ double ║║ string │ string ║║ []byte │ bytes ║║ protoreflect.Enum │ enum ║║ proto.Message │ message, group ║╚═══════════════════╧═════════════════════════╝
The protoreflect.Enum and proto.Message types are the concrete Go typeassociated with the named enum or message. Repeated fields are representedusing a Go slice of the base element type.
If a generated extension descriptor variable is directly passed toGetExtension, then the call should be followed immediately by atype assertion to the expected output value. For example:
mm := proto.GetExtension(m, foopb.E_MyExtension).(*foopb.MyMessage)
This pattern enables static analysis tools to verify that the asserted typematches the Go type associated with the extension field andalso enables a possible future migration to a type-safe extension API.
Since singular messages are the most common extension type, the pattern ofcalling HasExtension followed by GetExtension may be simplified to:
if mm := proto.GetExtension(m, foopb.E_MyExtension).(*foopb.MyMessage); mm != nil { ... // make use of mm}The mm variable is non-nil if and only if HasExtension reports true.
Example¶
package mainimport ("fmt""google.golang.org/protobuf/proto"extpb "google.golang.org/protobuf/internal/testprotos/examples/ext")func concertDetails() *extpb.Concert {concert := &extpb.Concert{}concert.SetHeadlinerName("Go Protobuf Acapella Band")proto.SetExtension(concert, extpb.E_PromoId, int32(2342))return concert}func main() {concert := concertDetails( /* req.ConcertID */ )fmt.Printf("finding backend server for live stream %q\n", concert.GetHeadlinerName())if proto.HasExtension(concert, extpb.E_PromoId) {promoId := proto.GetExtension(concert, extpb.E_PromoId).(int32)fmt.Printf("routing stream to high-priority backend (concert is part of promo %v)\n", promoId)} else {fmt.Printf("routing stream to default backend\n")}}Output:finding backend server for live stream "Go Protobuf Acapella Band"routing stream to high-priority backend (concert is part of promo 2342)
funcHasExtension¶
func HasExtension(mMessage, xtprotoreflect.ExtensionType)bool
HasExtension reports whether an extension field is populated.It returns false if m is invalid or if xt does not extend m.
funcMarshal¶
Marshal returns the wire-format encoding of m.
This is the most common entry point for encoding a Protobuf message.
See theMarshalOptions type if you need more control.
Example¶
This example illustrates how to marshal (encode) a Protobuf message structliteral into wire-format encoding.
This example hard-codes a duration of 125ns for the illustration of structfields, but note that you do not need to fill the fields of well-known typeslike duration.proto yourself. To convert a time.Duration, usegoogle.golang.org/protobuf/types/known/durationpb.New.
package mainimport ("fmt""google.golang.org/protobuf/proto""google.golang.org/protobuf/types/known/durationpb")func main() {b, err := proto.Marshal(&durationpb.Duration{Nanos: 125,})if err != nil {panic(err)}fmt.Printf("125ns encoded into %d bytes of Protobuf wire format:\n% x\n", len(b), b)// You can use protoscope to explore the wire format:// https://github.com/protocolbuffers/protoscope//// echo -n '10 7d' | xxd -r -ps | protoscope// 2: 125}Output:125ns encoded into 2 bytes of Protobuf wire format:10 7d
funcMerge¶
func Merge(dst, srcMessage)
Merge merges src into dst, which must be a message with the same descriptor.
Populated scalar fields in src are copied to dst, while populatedsingular messages in src are merged into dst by recursively calling Merge.The elements of every list field in src is appended to the correspondedlist fields in dst. The entries of every map field in src is copied intothe corresponding map field in dst, possibly replacing existing entries.The unknown fields of src are appended to the unknown fields of dst.
It is semantically equivalent to unmarshaling the encoded form of srcinto dst with the [UnmarshalOptions.Merge] option specified.
funcMessageName¶added inv1.26.0
func MessageName(mMessage)protoreflect.FullName
MessageName returns the full name of m.If m is nil, it returns an empty string.
funcRangeExtensions¶added inv1.22.0
func RangeExtensions(mMessage, f func(protoreflect.ExtensionType,any)bool)
RangeExtensions iterates over every populated extension field in m in anundefined order, calling f for each extension type and value encountered.It returns immediately if f returns false.While iterating, mutating operations may only be performedon the current extension field.
funcReset¶
func Reset(mMessage)
Reset clears every field in the message.The resulting message shares no observable memory with its previous stateother than the memory for the message itself.
funcSetExtension¶
func SetExtension(mMessage, xtprotoreflect.ExtensionType, vany)
SetExtension stores the value of an extension field.It panics if m is invalid, xt does not extend m, or if type of vis invalid for the specified extension field.
The type of the value is dependent on the field type of the extension.For extensions generated by protoc-gen-go, the Go type is as follows:
╔═══════════════════╤═════════════════════════╗║ Go type │ Protobuf kind ║╠═══════════════════╪═════════════════════════╣║ bool │ bool ║║ int32 │ int32, sint32, sfixed32 ║║ int64 │ int64, sint64, sfixed64 ║║ uint32 │ uint32, fixed32 ║║ uint64 │ uint64, fixed64 ║║ float32 │ float ║║ float64 │ double ║║ string │ string ║║ []byte │ bytes ║║ protoreflect.Enum │ enum ║║ proto.Message │ message, group ║╚═══════════════════╧═════════════════════════╝
The protoreflect.Enum and proto.Message types are the concrete Go typeassociated with the named enum or message. Repeated fields are representedusing a Go slice of the base element type.
If a generated extension descriptor variable is directly passed toSetExtension (e.g., foopb.E_MyExtension), then the value should be aconcrete type that matches the expected Go type for the extension descriptorso that static analysis tools can verify type correctness.This also enables a possible future migration to a type-safe extension API.
Example¶
package mainimport ("fmt""google.golang.org/protobuf/proto"extpb "google.golang.org/protobuf/internal/testprotos/examples/ext")func main() {concert := extpb.Concert_builder{HeadlinerName: proto.String("Go Protobuf Acapella Band"),}.Build()fmt.Printf("Has PromoId? %v\n", proto.HasExtension(concert, extpb.E_PromoId))proto.SetExtension(concert, extpb.E_PromoId, int32(2342))fmt.Printf("Has PromoId? %v\n", proto.HasExtension(concert, extpb.E_PromoId))}Output:Has PromoId? falseHas PromoId? true
funcSize¶
Size returns the size in bytes of the wire-format encoding of m.
Note that Size might return more bytes than Marshal will write in the case oflazily decoded messages that arrive in non-minimal wire format: seehttps://protobuf.dev/reference/go/size/ for more details.
Example¶
Checking ifSize returns 0 is an easy way to recognize empty messages:
package mainimport ("google.golang.org/protobuf/proto")func main() {var m proto.Messageif proto.Size(m) == 0 {// No fields set (or, in proto3, all fields matching the default);// skip processing this message, or return an error, or similar.}}funcUnmarshal¶
Unmarshal parses the wire-format message in b and places the result in m.The provided message must be mutable (e.g., a non-nil pointer to a message).
See theUnmarshalOptions type if you need more control.
Example¶
This example illustrates how to unmarshal (decode) wire format encoding intoa Protobuf message.
package mainimport ("fmt""google.golang.org/protobuf/proto""google.golang.org/protobuf/types/known/durationpb")func main() {// This is the wire format encoding produced by the Marshal example.// Typically you would read from the network, from disk, etc.b := []byte{0x10, 0x7d}var dur durationpb.Durationif err := proto.Unmarshal(b, &dur); err != nil {panic(err)}fmt.Printf("Protobuf wire format decoded to duration %v\n", dur.AsDuration())}Output:Protobuf wire format decoded to duration 125ns
funcValueOrDefault¶added inv1.36.0
ValueOrDefault returns the protobuf message val if val is not nil, otherwiseit returns a pointer to an empty val message.
This function allows for translating code from the old Open Struct API to thenew Opaque API.
The old Open Struct API represented oneof fields with a wrapper struct:
var signedImg *accountpb.SignedImageprofile := &accountpb.Profile{// The Avatar oneof will be set, with an empty SignedImage.Avatar: &accountpb.Profile_SignedImage{signedImg},}The new Opaque API treats oneof fields like regular fields, there are no morewrapper structs:
var signedImg *accountpb.SignedImageprofile := &accountpb.Profile{}profile.SetSignedImage(signedImg)For convenience, the Opaque API also offers Builders, which allow for adirect translation of struct initialization. However, because Builders usenilness to represent field presence (but there is no non-nil wrapper structanymore), Builders cannot distinguish between an unset oneof and a set oneofwith nil message. The above code would need to be translated with help of theValueOrDefault function to retain the same behavior:
var signedImg *accountpb.SignedImagereturn &accountpb.Profile_builder{SignedImage: proto.ValueOrDefault(signedImg),}.Build()funcValueOrDefaultBytes¶added inv1.36.0
ValueOrDefaultBytes is like ValueOrDefault but for working with fields oftype []byte.
funcValueOrNil¶added inv1.36.0
ValueOrNil returns nil if has is false, or a pointer to a new variablecontaining the value returned by the specified getter.
This function is similar to the wrappers (proto.Int32(), proto.String(),etc.), but is generic (works for any field type) and works with the hasserand getter of a field, as opposed to a value.
This is convenient when populating builder fields.
Example:
hop := attr.GetDirectHop()injectedRoute := ripb.InjectedRoute_builder{ Prefixes: route.GetPrefixes(), NextHop: proto.ValueOrNil(hop.HasAddress(), hop.GetAddress),}Types¶
typeMarshalOptions¶
type MarshalOptions struct {pragma.NoUnkeyedLiterals// AllowPartial allows messages that have missing required fields to marshal// without returning an error. If AllowPartial is false (the default),// Marshal will return an error if there are any missing required fields.AllowPartialbool// Deterministic controls whether the same message will always be// serialized to the same bytes within the same binary.//// Setting this option guarantees that repeated serialization of// the same message will return the same bytes, and that different// processes of the same binary (which may be executing on different// machines) will serialize equal messages to the same bytes.// It has no effect on the resulting size of the encoded message compared// to a non-deterministic marshal.//// Note that the deterministic serialization is NOT canonical across// languages. It is not guaranteed to remain stable over time. It is// unstable across different builds with schema changes due to unknown// fields. Users who need canonical serialization (e.g., persistent// storage in a canonical form, fingerprinting, etc.) must define// their own canonicalization specification and implement their own// serializer rather than relying on this API.//// If deterministic serialization is requested, map entries will be// sorted by keys in lexographical order. This is an implementation// detail and subject to change.Deterministicbool// UseCachedSize indicates that the result of a previous Size call// may be reused.//// Setting this option asserts that://// 1. Size has previously been called on this message with identical// options (except for UseCachedSize itself).//// 2. The message and all its submessages have not changed in any// way since the Size call. For lazily decoded messages, accessing// a message results in decoding the message, which is a change.//// If either of these invariants is violated,// the results are undefined and may include panics or corrupted output.//// Implementations MAY take this option into account to provide// better performance, but there is no guarantee that they will do so.// There is absolutely no guarantee that Size followed by Marshal with// UseCachedSize set will perform equivalently to Marshal alone.UseCachedSizebool}MarshalOptions configures the marshaler.
Example usage:
b, err := MarshalOptions{Deterministic: true}.Marshal(m)func (MarshalOptions)Marshal¶
func (oMarshalOptions) Marshal(mMessage) ([]byte,error)
Marshal returns the wire-format encoding of m.
func (MarshalOptions)MarshalAppend¶
func (oMarshalOptions) MarshalAppend(b []byte, mMessage) ([]byte,error)
MarshalAppend appends the wire-format encoding of m to b,returning the result.
This is a less common entry point thanMarshal, which is only needed if youneed to supply your own buffers for performance reasons.
Example (SameBuffer)¶
This example illustrates how to marshal (encode) many Protobuf messages intowire-format encoding, using the same buffer.
MarshalAppend will grow the buffer as needed, so over time it will grow largeenough to not need further allocations.
If unbounded growth of the buffer is undesirable in your application, you canuseMarshalOptions.Size to determine a buffer size that is guaranteed to belarge enough for marshaling without allocations.
package mainimport ("google.golang.org/protobuf/proto")func main() {var m proto.Messageopts := proto.MarshalOptions{// set e.g. Deterministic: true, if needed}var buf []bytefor i := 0; i < 100000; i++ {var err errorbuf, err = opts.MarshalAppend(buf[:0], m)if err != nil {panic(err)}// cap(buf) will grow to hold the largest m.// write buf to disk, network, etc.}}func (MarshalOptions)MarshalState¶
func (oMarshalOptions) MarshalState(inprotoiface.MarshalInput) (protoiface.MarshalOutput,error)
MarshalState returns the wire-format encoding of a message.
This method permits fine-grained control over the marshaler.Most users should useMarshal instead.
func (MarshalOptions)Size¶
func (oMarshalOptions) Size(mMessage)int
Size returns the size in bytes of the wire-format encoding of m.
Note that Size might return more bytes than Marshal will write in the case oflazily decoded messages that arrive in non-minimal wire format: seehttps://protobuf.dev/reference/go/size/ for more details.
typeMessage¶
type Message =protoreflect.ProtoMessage
Message is the top-level interface that all messages must implement.It provides access to a reflective view of a message.Any implementation of this interface may be used with all functions in theprotobuf module that accept a Message, except where otherwise specified.
This is the v2 interface definition for protobuf messages.The v1 interface definition isgithub.com/golang/protobuf/proto.Message.
- To convert a v1 message to a v2 message,usegoogle.golang.org/protobuf/protoadapt.MessageV2Of.
- To convert a v2 message to a v1 message,usegoogle.golang.org/protobuf/protoadapt.MessageV1Of.
typeUnmarshalOptions¶
type UnmarshalOptions struct {pragma.NoUnkeyedLiterals// Merge merges the input into the destination message.// The default behavior is to always reset the message before unmarshaling,// unless Merge is specified.Mergebool// AllowPartial accepts input for messages that will result in missing// required fields. If AllowPartial is false (the default), Unmarshal will// return an error if there are any missing required fields.AllowPartialbool// If DiscardUnknown is set, unknown fields are ignored.DiscardUnknownbool// Resolver is used for looking up types when unmarshaling extension fields.// If nil, this defaults to using protoregistry.GlobalTypes.Resolver interface {FindExtensionByName(fieldprotoreflect.FullName) (protoreflect.ExtensionType,error)FindExtensionByNumber(messageprotoreflect.FullName, fieldprotoreflect.FieldNumber) (protoreflect.ExtensionType,error)}// RecursionLimit limits how deeply messages may be nested.// If zero, a default limit is applied.RecursionLimitint//// NoLazyDecoding turns off lazy decoding, which otherwise is enabled by// default. Lazy decoding only affects submessages (annotated with [lazy =// true] in the .proto file) within messages that use the Opaque API.NoLazyDecodingbool}UnmarshalOptions configures the unmarshaler.
Example usage:
err := UnmarshalOptions{DiscardUnknown: true}.Unmarshal(b, m)func (UnmarshalOptions)Unmarshal¶
func (oUnmarshalOptions) Unmarshal(b []byte, mMessage)error
Unmarshal parses the wire-format message in b and places the result in m.The provided message must be mutable (e.g., a non-nil pointer to a message).
func (UnmarshalOptions)UnmarshalState¶
func (oUnmarshalOptions) UnmarshalState(inprotoiface.UnmarshalInput) (protoiface.UnmarshalOutput,error)
UnmarshalState parses a wire-format message and places the result in m.
This method permits fine-grained control over the unmarshaler.Most users should useUnmarshal instead.