Apigee hybrid release notes

This page documents production updates to Apigee hybrid in 2022 and later.We recommend that users periodically check this list forany new announcements, orsubscribe to this page using afeed reader to get notifications of updates.

What is a feed reader?

Really simple syndication (RSS) feed readers aggregate content from websites that you specify.

Feed reader notifications can be email-, browser-, desktop-, or mobile-based. Some readers are free, or have free versions, and some require a subscription.

A few examples:

More information on RSS:

See also:

Subscribe:

You can see the latest product updates for all of Google Cloud on the Google Cloud page, browse and filter all release notes in theGoogle Cloud console, or programmatically access release notes inBigQuery.

To get the latest product updates delivered to you, add the URL of this page to yourfeed reader, or add thefeed URL directly.

February 06, 2026

v1.16.0-hotfix.1
Announcement

hybrid 1.16.0-hotfix.1

On February 6, 2026 we released Apigee hybrid 1.16.0-hotfix.1.

Important: If your installation is already on Apigee hybrid v1.16.0, use the following procedure to apply this hotfix. For new installations, seeThe big picture and then apply the hotfix to the new installation with the following instructions.

Apply this hotfix with the following steps:

Note: This hotfix installs theapigee-mart-server container images. All other container images are unchanged from Hybrid v1.16.0.
  1. In your overrides file, update theimage.url andimage.tag properties ofao andmart to version1.16.0-hotfix.1:
    ao:  image:    url: "gcr.io/apigee-release/hybrid/apigee-operators"    tag: "1.16.0-hotfix.1"mart:  image:    url: "gcr.io/apigee-release/hybrid/apigee-mart-server"    tag: "1.16.0-hotfix.1"
  2. Install the hotfix release for Apigee operators, beginning with a dry run:
    helm upgrade operator apigee-operator/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --atomic \  -f overrides.yaml \  --dry-run=server
  3. If the dry run is successful, install the hotfix release for Apigee operators:
    helm upgrade operator apigee-operator/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --atomic \  -f overrides.yaml
  4. Install the hotfix release for your organization, beginning with a dry run:
    helm upgrade $ORG_NAME apigee-org/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --atomic \  -f overrides.yaml \  --dry-run=server
  5. If the dry run is successful, install the hotfix release for your organization:
    helm upgrade $ORG_NAME apigee-org/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --atomic \  -f overrides.yaml
  6. Verify the organization chart by checking the state:
    kubectl -nAPIGEE_NAMESPACE get apigeeorg
  7. Install the hotfix release for your environment, beginning with a dry run:
    helm upgradeENV_RELEASE_NAME apigee-env/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --atomic \  --set env=$ENV_NAME \  -f overrides.yaml \  --dry-run=server
  8. If the dry run is successful, install the hotfix release for your environment:
    helm upgradeENV_RELEASE_NAME apigee-env/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --atomic \  --set env=$ENV_NAME \  -f overrides.yaml
  9. Verify the environment chart by checking the state:
    kubectl -nAPIGEE_NAMESPACE get apigeeenv

December 19, 2025

v1.16.0
Feature

Seccomp Profiles

Apigee Hybrid now offers the capability to apply Seccomp Profiles to your runtime components, significantly enhancing the security posture of your deployment.

This feature allows Apigee administrators and security teams to restrict the system calls (syscalls) a containerized process can make to the host's kernel. By limiting a container to only the necessary syscalls, you can:

  • Enhance Security: Mitigate the risk of container breakouts and privilege escalation.
  • Enforce Least Privilege: Ensure components only have access to the exact system calls required for their operation.
  • Meet Compliance: Provide a critical control for meeting stringent security compliance requirements.

Seccomp profiles are not enabled by default. To enable the feature, seeConfigure Seccomp profiles for pod security.

v1.16.0
v1.16.0
Change

UDCA component removed

In Apigee hybrid v1.16, the Unified Data Collection Agent (UDCA) component has been removed. The responsibilities of sending analytics, trace, and deployment status data to the Apigee control plane are now handled using aGoogle Cloud Pub/Sub based data pipeline. Using the Pub/Sub based data pipeline has been the default data collection mechanism sinceApigee hybrid v1.14.0.

v1.16.0
v1.16.0
Fixed

Fixed in this release

Bug IDDescription
448647917Fixed a issue where non-SSL connections through a forward proxy could be improperly shared. (also fixed inApigee 1-16-0-apigee-4)
442501403Fixed an issue that caused incorrect target latency metrics in Apigee Analytics when a TargetEndpoint is configured with a <LoadBalancer>. (also fixed inApigee 1-16-0-apigee-3)
438192028Updated the geolocation database to mitigate stale IP-to-location mappings. (also fixed inApigee 1-16-0-apigee-3)
437999897Reduced the log level for failed geo IP lookups to address excessive log messages for private IP addresses. (also fixed inApigee 1-16-0-apigee-3)
436323210Fixed ingress cert keys to allow bothtls.key/key andtls.crt/cert.
N/AUpdates to security, infrastructure, and libraries. (also fixed inApigee 1-16-0-apigee-4)
v1.16.0
Fixed

Fixed since last minor release

Bug IDDescription
451841788Apigee hybrid required themintTaskScheduler.serviceAccountPath property even when Monetization was not enabled. (Fixed inv1.15.1 &v1.14.3)
451375397Theapigee-pull-push.sh script could return a No such image error message. (Fixed inv1.15.1 &v1.14.3)
445912919Unused files and folders have been removed from the Apigee hybrid Helm charts to prevent potential security exposure and streamline the product installation and upgrade process. (Fixed inv1.15.1)
442501403Fixed an issue that caused incorrect target latency metrics in Apigee Analytics when aTargetEndpoint is configured with a<LoadBalancer>. (Fixed inv1.15.1)
437999897Reduced the log level for failed geo IP lookups to address excessive log messages for private IP addresses. (Fixed inv1.15.1)
431930277,395272878When the configuration propertyenvs.managementCallsSkipProxy is set totrue via helm for environment-level forward proxy, trace and analytics (which usegoogleapis.com) will skip forward proxy. (Fixed inv1.15.1)
423597917Post of anAppGroupAppKey scopes should result in insert operation instead of update. (Fixed inv1.15.1 &v1.14.3)
420675540Fixed Cassandra based replication for runtime contracts in synchronizer. (Fixed inv1.15.1,v1.14.3 &v1.13.4)
419578402Mint-Mart forward proxy compatible. (Fixed inv1.15.1 &v1.14.3)
416634326Presence of istio.io Custom Resource Definitions (CRDs) in an Apigee hybrid cluster could cause failure in apigee-ingressgateway-manager pods. (Fixed inv1.15.1,v1.14.3 &v1.13.4)
414499328ApigeeTelemetry could become stuck increating state (Fixed inv1.14.3 &v1.13.4)
412740465Fixed issue where zipkin headers were not generated by Apigee Ingress Gateway. (Fixed inv1.15.1 &v1.14.3)
409048431Fixes a vulnerability which could allow a SAML signature verification to be bypassed. (Fixed inv1.15.1 &v1.14.3)
401746333Fixed ajava.lang.ClassCircularityError that could occur in Java Callouts due to an issue with the class loading mechanism.(Fixed inv1.15.1 &v1.14.3)
395272878Separate Forward proxy support forgoogleapis.com andnon-googleapis.com runtime traffic. (Fixed inv1.14.3)
393615439OASValidation behavior forallOf withadditionalProperties: true. (Fixed in1.14.2-hotfix.1)
382565315A memory leak within the Security Policy has been addressed, improving system stability. (Fixed inv1.13.4)
378686709The use of wildcards (*) in Apigee proxy basepaths would conflict with other explicit basepaths, resulting in a 404 error. To apply this fix, follow the procedure inKnown issue 378686709. (Fixed inv1.15.1 &v1.14.3)
375360455Updated apigee-runtime drain timeout to 300s to fix connection termination issue during pod termination. (Fixed inv1.13.4)
367815792Two new Flow Variables:app_group_app andapp_group_name have been added to VerifyApiKey and Access Token policy. (Fixed inv1.15.1 &v1.14.3)
v1.16.0
Security

Fixed in this release

Bug IDDescription
452621774, 452381632, 441266643, 448498138Security fix for Apigee infrastructure. (also fixed inApigee 1-16-0-apigee-4)
This addresses the following vulnerabilities:

440419558, 433759657Security fix for Apigee infrastructure. (also fixed inApigee 1-16-0-apigee-3)

This addresses the following vulnerabilities:

443902061Security fix for Apigee infrastructure (also fixed inApigee 1-16-0-apigee-3)

This addresses the following vulnerability:

  • CVE-2025-13292

    Fixed an issue with improper access control that resulted in cross-tenant analytics modification and access to log data.

N/ASecurity fixes forapigee-asm-ingress.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-asm-istiod.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-connect-agent.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-operators.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-runtime.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-synchronizer.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-udca.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-watcher.
This addresses the following vulnerabilities:
v1.16.0
Security

Fixed since last minor release

Bug IDDescription
448498138Security fixes forapigee-runtime. (Fixed inv1.15.1)
This addresses the following vulnerability:
447367372Security fixes forapigee-runtime. (Fixed inv1.15.1)
This addresses the following vulnerability:
433952146Security fix. (Fixed inv1.14.3)
This addresses the following vulnerability:
433951774Security fix. (Fixed inv1.14.3)
This addresses the following vulnerability:
433950558Security fix. (Fixed inv1.14.3)
This addresses the following vulnerability:
433950370Security fix. (Fixed inv1.14.3)
This addresses the following vulnerability:
418557195Security fixes forapigee-fluent-bit. (Fixed inv1.15.1)
This addresses the following vulnerabilities:
396944778Security fixes forapigee-synchronizer. (Fixed inv1.13.4)
This addresses the following vulnerabilities:
392934392Security fixes forapigee-logger.
N/AIncorporated an updated base image forstackdriver-logging-agent, improving the overall security of the service. (Fixed in1.14.2-hotfix.1)
This addresses the following vulnerabilities (among others and not limited to):
N/ASecurity fixes forapigee-asm-ingress. (Fixed inv1.14.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-istiod. (Fixed inv1.14.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-envoy. (Fixed inv1.14.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit. (Fixed inv1.14.3 &v1.15.1)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client. (Fixed inv1.14.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra. (Fixed inv1.14.3)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra. (Fixed inv1.15.1)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-kube-rbac-proxy. (Fixed inv1.14.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mart-server. (Fixed inv1.13.4)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mart-server. (Fixed inv1.14.3)
This addresses the following vulnerabilities:

October 12, 2025

v1.15.1
v1.15.1
Feature

Recurring, top-up, and setup fees for Apigee hybrid monetization

Apigee hybrid now supports recurring, top-up, and setup fees for monetization. For information seeEnabling monetization for Apigee hybrid.

v1.15.1
Feature

Apigee policies for LLM/GenAI workloads

Apigee hybrid now supports the following Apigee policies with support for LLM/GenAI workloads.

The Apigee semantic caching policies enable intelligent response reuse based on semantic similarity. Using these policies in your Apigee API proxies can minimize redundant backend API calls, reduce latency, and lower operational costs. With this release, the semantic caching policies support URL templating, enabling the use of variables for AI model endpoint values.

The Model Armor policies protect your AI applications by sanitizing user prompts to and responses from large language models (LLMs). Using these policies in your Apigee API proxies can mitigate the risks associated with LLM usage by leveraging Model Armor to detect prompt injection, prevent jailbreak attacks, apply responsible AI filters, filter malicious URLs, and protect sensitive data.

Note: In Apigee hybrid, this feature has the following limitations:
  • Support for these policies is limited to installations on Google Cloud Platform.
  • Apigee hybrid does not support forward proxy with these policies.

For more information on using these policies in your Apigee API proxies, see:

v1.15.1
Fixed
Bug IDDescription
451841788Apigee hybrid required themintTaskScheduler.serviceAccountPath property even when Monetization was not enabled.
451375397Theapigee-pull-push.sh script could return a "No such image error" message.
445912919Unused files and folders have been removed from the Apigee hybrid Helm charts to prevent potential security exposure and streamline the product installation and upgrade process.
442501403Fixed an issue that caused incorrect target latency metrics in Apigee Analytics when aTargetEndpoint is configured with a<LoadBalancer>.
437999897Reduced the log level for failed geo IP lookups to address excessive log messages for private IP addresses.
431930277,395272878When the configuration propertyenvs.managementCallsSkipProxy is set totrue via helm for environment-level forward proxy, trace and analytics (which usegoogleapis.com) will skip forward proxy.
423597917Post of anAppGroupAppKey scopes should result in insert operation instead of update.
420675540Fixed Cassandra based replication for runtime contracts in synchronizer.
419578402Mint-Mart forward proxy compatible.
416634326Presence of istio.io Custom Resource Definitions (CRDs) in an Apigee hybrid cluster could cause failure in apigee-ingressgateway-manager pods.
412740465Fixed issue where zipkin headers were not generated by Apigee Ingress Gateway.
409048431Fixes a vulnerability which could allow a SAML signature verification to be bypassed.
378686709The use of wildcards (*) in Apigee proxy basepaths would conflict with other explicit basepaths, resulting in a 404 error. To apply this fix, follow the procedure inKnown issue 378686709.
367815792Two new Flow Variables:app_group_app andapp_group_name have been added to VerifyApiKey and Access Token policy.
v1.15.1
Security
Bug IDDescription
448498138Security fixes forapigee-runtime.
This addresses the following vulnerability:
447367372Security fixes forapigee-runtime.
This addresses the following vulnerability:
418557195Security fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerabilities:
v1.15.1
Change

Documentation change

The following documents have been changed or introduced to align the Apigee hybrid installation guides with the supported methods for service account authentication:

October 07, 2025

v1.14.3
Announcement

hybrid v1.14.3

On October 7, 2025 we released an enhancement to Apigee hybrid version 1.14.3, recurring, top-up, and setup fees for Apigee hybrid monetization.

Note: This is an enhancement to an existing release.
v1.14.3
Feature

Recurring, top-up, and setup fees for Apigee hybrid monetization

Apigee hybrid now supports recurring, top-up, and setup fees for monetization. For information seeEnabling monetization for Apigee hybrid.

v1.14.3
Fixed
Bug IDDescription
419578402Mint-Mart forward proxy compatible.

September 29, 2025

v1.14.3
v1.14.3
Fixed
Bug IDDescription
451841788Apigee hybrid required themintTaskScheduler.serviceAccountPath property even when Monetization was not enabled.
451375397Theapigee-pull-push.sh script could return a "No such image" error message.
423597917Post of anAppGroupAppKey scopes should result in insert operation instead of update.
420675540Fixed Cassandra based replication for runtime contracts in synchronizer.
416634326Presence of istio.io Custom Resource Definitions (CRDs) in an Apigee hybrid cluster could cause failure in apigee-ingressgateway-manager pods.
414499328ApigeeTelemetry could become stuck increating state
412740465Fixed issue where zipkin headers were not generated by Apigee Ingress Gateway.
409048431Fixes a vulnerability which could allow a SAML signature verification to be bypassed.
395272878Separate Forward proxy support forgoogleapis.com andnon-googleapis.com runtime traffic.
378686709The use of wildcards (*) in Apigee proxy basepaths would conflict with other explicit basepaths, resulting in a 404 error. To apply this fix, follow the procedure inKnown issue 378686709.
367815792Two new Flow Variables:app_group_app andapp_group_name have been added to VerifyApiKey and Access Token policy.
v1.14.3
Security
Bug IDDescription
433952146Security fix.
This addresses the following vulnerability:
433951774Security fix.
This addresses the following vulnerability:
433950558Security fix.
This addresses the following vulnerability:
433950370Security fix.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-ingress.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-istiod.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-envoy.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-operators.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-watcher.
This addresses the following vulnerability:

September 24, 2025

v1.15.0
Announcement

Apigee Operator for Kubernetes for Apigee Hybrid (Preview)

On September 24, 2025 we released the Apigee Operator for Kubernetes for Apigee Hybrid 1.15.0 and newer.

The Apigee Operator for Kubernetes allows you to perform API management tasks, such as defining API products and operations, using Kubernetes tools. This preview release allows you to integrate this capability with your Apigee hybrid (v1.15.0 or newer) installation.

For more information, see:

July 09, 2025

v1.13.4
Announcement

hybrid v1.13.4

On July 9, 2025 we released an updated version of the Apigee hybrid software, 1.13.4.

Note: if you are upgrading to Apigee hybrid version 1.13.4 from version 1.13.2 or earlier, seeAPPENDIX: Validate policies after upgrade to 1.13.3 or later for steps to address stricter class instantiation checks introduced inversion 1.13.3.Note: This is a patch release: The container images used in patch releases are integrated with the Apigee hybrid Helm charts. Upgrading to a patch via the Helm chart automatically updates the images. No manual image changes are typically needed. For information on container image support in Apigee hybrid releases, seeApigee release process.
v1.13.4
Fixed
Bug IDDescription
420675540Fixed Cassandra based replication for runtime contracts in synchronizer.
401746333Fixed ajava.lang.ClassCircularityError that could occur in Java Callouts due to an issue with the class loading mechanism.
382565315A memory leak within the Security Policy has been addressed, improving system stability.
375360455Updated apigee-runtime drain timeout to 300s to fix connection termination issue during pod termination.
v1.13.4
Security
Bug IDDescription
396944778Security fixes forapigee-synchronizer.
This addresses the following vulnerabilities:
392934392Security fixes forapigee-logger.
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-runtime.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-synchronizer.
This addresses the following vulnerability:
N/ASecurity fixes forvault.
This addresses the following vulnerability:

June 04, 2025

v1.15.0
v1.15.0
Feature

Large message payload support in Apigee hybrid

Apigee now supports message payloads up to 30MB. You configure support for large message payloads in Apigee hybrid for individual environments or for your whole installation. SeeConfigure large message payload support in Apigee hybrid.

v1.15.0
Fixed
Bug IDDescription
414499328ApigeeTelemetry could become stuck increating state (Fixed inv1.15.0)
412324617Fixed issue where Runtime container could spin at 100% cpu limit. (Fixed inv1.14.2)
399447688API proxy deployment could become stuck inPROGRESSING state. (Fixed inv1.14.2)
396886110Fixed a bug where the HPA max replicas could be lower than min. (Fixed inv1.14.1)
413708061,396571537Rotating Cassandra credentials in Kubernetes secrets fixed for Multi-region deployments. (Fixed inv1.14.2)
392547038Add Helm chart template checks for non-existent environments and virtualhosts. (Fixed inv1.14.1)
391861216Restore for Google Cloud Platform and HYBRID Cloud Providers no longer affects system keyspaces. This fixesKnown Issue 391861216. (Fixed inv1.14.1)
390258745,388608440Any left over Cassandra snapshots are automatically removed. This fixesknown issue 388608440. (Fixed inv1.14.1)
384937220FixedApigeeRoute name collision on internal chaining gateway for Enhanced Proxy Limits. (Fixed inv1.14.2)
383441226Added the followingmetrics configuration properties: (Fixed inv1.14.1)
368155212Auto Cassandra secret rotation could fail whenEnhanced per-environment proxy limits are enabled. (Fixed inv1.14.2)
367681534Taggingapigee-stackdriver-prometheus-sidecar to prevent removal from customer repos after 2 years due to infrequent updates. (Fixed in1.14.0-hotfix.1)
v1.15.0
Security

Fixed in this release

Bug IDDescription
N/ASecurity fixes forapigee-asm-ingress.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-istiod.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-connect-agent.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-envoy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-operators.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-runtime.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-synchronizer.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-watcher.
This addresses the following vulnerability:
N/ASecurity fixes forcert-manager-cainjector.
This addresses the following vulnerabilities:
N/ASecurity fixes forcert-manager-controller.
This addresses the following vulnerabilities:
N/ASecurity fixes forcert-manager-webhook.
This addresses the following vulnerabilities:
N/ASecurity fixes forvault.
This addresses the following vulnerability:
v1.15.0
Security

Fixed since last minor release

Bug IDDescription
391923260Security fixes forapigee-watcher. (Fixed inv1.14.1)
This addresses the following vulnerabilities:
391923260Security fixes forapigee-udca. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
385394193,383850393,383778273Security fixes forapigee-cassandra-backup-utility,apigee-cassandra-client, andapigee-hybrid-cassandra. (Fixed inv1.14.1)
This addresses the following vulnerabilities:
385394193,383850393,383778273Security fixes forapigee-cassandra-backup-utility,apigee-cassandra-client, andapigee-hybrid-cassandra. (Fixed inv1.13.3)
This addresses the following vulnerabilities:
383113773, 382967738Fixed a vulnerability in PythonScript policy. (Fixed inv1.14.1)
365178914Security fixes forapigee-cassandra-backup-utility andapigee-hybrid-cassandra. (Fixed inv1.14.1)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-watcher. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-udca. (Fixed inv1.13.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-stackdriver-logging-agent. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-redis. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter. (Fixed inv1.14.2)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-prometheus-adapter. (Fixed inv1.14.1)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-operators. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector. (Fixed inv1.14.1)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mint-task-scheduler. (Fixed inv1.14.2)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mint-task-scheduler. (Fixed inv1.14.1)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mint-task-scheduler. (Fixed inv1.13.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-kube-rbac-proxy. (Fixed inv1.13.3)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra. (Fixed inv1.14.2)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra. (Fixed inv1.14.1)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra. (Fixed inv1.13.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra-client. (Fixed inv1.14.2)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit. (Fixed inv1.14.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit. (Fixed inv1.13.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-istiod. (Fixed inv1.14.1)
This addresses the following vulnerability:

May 29, 2025

v1.14.2
Announcement

On May 29, 2025 we announced the shutdown schedule for the Apigee Classic UI.

v1.14.2
Deprecated

The Apigee Classic UI will be shutdown as of August 29, 2025.

This is the final phase of moving Apigee to the Google Cloud console. Apigee in the Google Cloud console gives you the ability to manage all of your Apigee functionality in one place.

To prepare for the shutdown of the Apigee Classic UI, familiarize yourself with the new Apigee UI in Google Cloud console by reviewingUI overview.

SeeApigee Classic UI shutdown for details on shutdown dates and exception request.

May 16, 2025

1.14.2-hotfix.1
Announcement

hybrid 1.14.2-hotfix.1

On May 16, 2025 we released an updated version of the Apigee hybrid software, 1.14.2-hotfix.1.

Important: If your installation is already on Apigee hybrid v1.14.2, use the following procedure to apply this hotfix. If your installation is on 1.14.1 or older, follow the instructions inUpgrading Apigee hybrid to version 1.14.

Apply this hotfix with the following steps:

  1. Download theapigee-org andapigee-env charts with the1.14.2-hotfix.1 version tag:

    export CHART_REPO=oci://us-docker.pkg.dev/apigee-release/apigee-hybrid-helm-chartsexport CHART_VERSION=1.14.2-hotfix.1helm pull $CHART_REPO/apigee-env --version $CHART_VERSION --untarhelm pull $CHART_REPO/apigee-org --version $CHART_VERSION --untar
  2. Optional: Perform this step if you need to allow use of theallOf combinator along with settingadditionalProperties: true in your OAS spec. Seefixed bug 393615439.

    Add the following stanza to youroverrides.yaml:

    runtime:cwcAppend:conf_message-processor-communication_oas.disable.resolve.combinator:true
  3. Install the hotfix release:

    1. Update theapigee-env chart with thehelm upgrade command and your current overrides file for each environment in your Apigee org:

      Dry run:

      helm upgradeENV_RELEASE_NAME apigee-env/ \--namespaceAPIGEE_NAMESPACE \--set env=ENV_NAME \--atomic \-fOVERRIDES_FILE \--dry-run=server
      • ENV_RELEASE_NAME is a name used to keep track of installation and upgrades of theapigee-env chart. This name must be unique from the other Helm release names in your installation. Usually this is the same asENV_NAME. However, if your environment has the same name as your environment group, you must use different release names for the environment and environment group, for exampledev-env-release anddev-envgroup-release. For more information on releases in Helm, seeThree big concepts in the Helm documentation.
      • APIGEE_NAMESPACE is your installation's namespace. The default isapigee.
      • ENV_NAME is the name of the environment you are upgrading.
      • OVERRIDES_FILE is your edited overrides file.

      Install the changes:

      helm upgradeENV_RELEASE_NAME apigee-env/ \--namespaceAPIGEE_NAMESPACE \--set env=ENV_NAME \--atomic \-fOVERRIDES_FILE
    2. Update theapigee-org chart:

      Dry run:

      helm upgradeORG_NAME apigee-org/ \--namespaceAPIGEE_NAMESPACE \-fOVERRIDES_FILE \--dry-run=server

      Install the changes:

      helm upgradeORG_NAME apigee-org/ \--namespaceAPIGEE_NAMESPACE \-fOVERRIDES_FILE
  4. Verify the installation:

    Ensure runtime and udca pods are up and running by checking their state:

    kubectl -n APIGEE_NAMESPACE get pods -l app=apigee-runtime
    kubectl -n APIGEE_NAMESPACE get pods -l app=apigee-udca

Note: This is a hotfix release: For critical security and other immediate fixes, Apigee provides specific container image tags that you must manually update in your existing deployments. The Helm chart binary usually remains unchanged for hotfixes. Hotfixes are temporary and their changes will be included in the next standard release. For information on container image support in Apigee hybrid releases, seeApigee release process.
1.14.2-hotfix.1
Fixed
Bug IDDescription
393615439OASValidation behavior forallOf withadditionalProperties: true.

Issue

The OASValidation policy in Apigee Hybrid versions 1.12 and later may incorrectly reject requests when validating against an OpenAPI Specification (OAS) that uses combinator keywords (allOf,oneOf,anyOf) and allows additional properties (additionalProperties: true) within the combined schema. This occurs because the default behavior resolves combinators into an aggregated schema before validation, but an underlying issue in the parser library can cause theadditionalProperties definition to be handled incorrectly during this resolution. This behavior differs from Apigee Edge and older Apigee Hybrid versions.

Resolution

A configuration flag has been introduced to control this behavior. By setting this flag, you can disable the pre-validation combinator resolution step, reverting to the behavior consistent with Apigee Edge and older Hybrid versions.

Validation errors in Apigee hybrid

If you encounter the validation errors described above, particularly for specs that worked correctly in Apigee Edge or Hybrid versions prior to 1.12, you can revert to the previous validation behavior by setting the following flag for the apigee-runtime container:

conf_message-processor-communication_oas.disable.resolve.combinator = true
Note: Reverting to the older behavior (by setting the flag to true) reintroduces the older limitation: When usingallOf, theadditionalProperties keyword must be explicitly set to true if you intend to make the inheritance work correctly. The older behavior does not correctly handle schema validation withallOf whenadditionalProperties is set to false or is undefined. Customers migrating from Edge/OPDK or older hybrid versions should already be working around this limitation.
1.14.2-hotfix.1
Security
Bug IDDescription
N/AIncorporated an updated base image forstackdriver-logging-agent, improving the overall security of the service.
This addresses the following vulnerabilities (among others and not limited to):

May 02, 2025

v1.14.2
v1.14.2
Feature

Large message payload support in Apigee hybrid

Apigee now supports message payloads up to 30MB. For information see:

v1.14.2
Change

Starting with v1.14.2, third-party container images will be labeled with a version tag that matches the Apigee hybrid image tag. This affects the image tags returned by theapigee-pull-push command line tool. For more information, see:

Note: You can see the original component container image tags as a label with thedocker history anddocker inspect commands.
Security
Bug IDDescription
391923260Security fixes forapigee-udca.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-operators.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-watcher.
This addresses the following vulnerabilities:

April 14, 2025

Announcement

hybrid 1.11.2-hotfix.3

On April 14, 2025 we released an updated version of the Apigee hybrid software, 1.11.2-hotfix.3.

Apply this hotfix with the following steps:

  1. In your overrides file, update theimage.url andimage.tag properties ofao andruntime:

    runtime:image:url:"gcr.io/apigee-release/hybrid/apigee-runtime"tag:"1.11.2-hotfix.3"
  2. Install the hotfix release:

Note: This is a hotfix release: For critical security and other immediate fixes, Apigee provides specific container image tags that you must manually update in your existing deployments. The Helm chart binary usually remains unchanged for hotfixes. Hotfixes are temporary and their changes will be included in the next standard release. For information on container image support in Apigee hybrid releases, see theApigee release process.
v1.14.0
Feature

Announcing data collectors data residency (DRZ) compliance for Apigee and Apigee hybrid.

Data collectors can be used with data residency for Subscription and Pay-as-you-go organizations and hybrid versions 1.14.0 and later.

SeeData residency compatibility for information.

1.11.2-hotfix.3
Security

Stricter class instantiation checks included in this release.

JavaCallout policy now includes additional security during Java class instantiation. The enhanced security measure prevents the deployment of policies that directly or indirectly attempt actions that require permissions that are not allowed.

In most cases, existing policies will continue to function as expected without any issues. However, there is a possibility that policies relying on third-party libraries, or those with custom code that indirectly triggers operations requiring elevated permissions, could be affected.

To test your installation, follow the procedure inValidate policies after upgrade to 1.11.2-hotfix.3 to validate policy behavior.

Bug IDDescription
382967738Fixed a vulnerability in PythonScript policy.

March 27, 2025

v1.14.0
Announcement

On March 27, 2025, we released an updated version of Apigee.

v1.14.0
Feature

Availability of client IP resolution functionality with Apigee hybrid.

Client IP resolution functonality is now available with Apigee hybrid versions 1.14.0 and later.

SeeClient IP resolution for information.

March 25, 2025

v1.14.0
Announcement

On March 25, 2025 we released an updated version of Advanced API Security.

v1.14.0
Change

New Advanced API Security support when using data residency (DRZ) with Apigee hybrid

Advanced API Security is now available for Apigee hybrid orgs using DRZ, for hybrid versions 1.14.0 and later. SeeUsing data residency with Apigee hybrid.

SeeIntroduction to data residency for information on DRZ and Advanced API Security support across organization types.

March 12, 2025

v1.13.3 & v1.14.1 & v1.12.4
Issue

March 01, 2025

Announcement

hybrid v1.14.1

On March 1, 2025 we released an updated version of the Apigee hybrid software, 1.14.1.

This release enhances the security posture within theJavaCallout andPythonScript policies. This release does not include any new features or general bug fixes.

v1.14.1
Fixed
Bug IDDescription
396886110Fixed a bug where the HPA max replicas could be lower than min.
392547038Add Helm chart template checks for non-existent environments and virtualhosts.
391861216Restore for Google Cloud Platform and HYBRID Cloud Providers no longer affects system keyspaces. This fixesKnown Issue 391861216.
390019667Fixed bug where the daemonsets had an invalid pod disruption budget which prevented downscaling.
383441226Added the followingmetrics configuration properties:
382565315LogTimer usage in SecurityPolicy could cause a memory leak.
v1.14.1
Security

Stricter class instantiation checks included in this release.

JavaCallout policy now includes additional security during Java class instantiation. The enhanced security measure prevents the deployment of policies that directly or indirectly attempt actions that require permissions that are not allowed.

In most cases, existing policies will continue to function as expected without any issues. However, there is a possibility that policies relying on third-party libraries, or those with custom code that indirectly triggers operations requiring elevated permissions, could be affected.

To test your installation, follow the procedure inValidate policies after upgrade to 1.14.1 to validate policy behavior.

Bug IDDescription
385394193,383850393,383778273Security fixes forapigee-cassandra-backup-utility,apigee-cassandra-client, andapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
383113773, 382967738Fixed a vulnerability in PythonScript policy.
365178914Security fixes forapigee-cassandra-backup-utility andapigee-hybrid-cassandra.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-istiod.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerability:
392174215Security fixes forapigee-operator.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
391786033Security fixes forapigee-watcher.
This addresses the following vulnerability:
388271708Security fix for Apigee infrastructure

This addresses the following vulnerability:

  • CVE-2025-13426

    Fixed an issue with the JavaCallout policy that could result in remote code execution.

v1.14.1
Announcement

Manage process ID limits

The procedure to manage the process ID limits in your clusters has been added to the documentation.

A Process ID limit is a Kubernetes resource constraint on nodes and pods to prevent excessive process creation, which can impact node stability. Setting process ID limits in Kubernetes can improve system stability, security, and resource management. This is also consistent with Kubernetes best practices. Apigee Hybrid supports the Kubernetes feature to set process ID limits.

See:Manage process ID limits.

v1.13.3
Announcement

hybrid v1.13.3

On March 1, 2025 we released an updated version of the Apigee hybrid software, 1.13.3.

This release enhances the security posture within theJavaCallout andPythonScript policies. This release does not include any new features or general bug fixes.

v1.13.3
Fixed
Bug IDDescription
396886110Fixed a bug where the HPA max replicas could be lower than min.
391861216Restore for Google Cloud Platform and HYBRID Cloud Providers no longer affects system keyspaces. This fixesKnown Issue 391861216.
390258745,388608440Any left over Cassandra snapshots are automatically removed. This fixesknown issue 388608440.
390019667Fixed bug where the daemonsets had an invalid pod disruption budget which prevented downscaling.
383441226Added the followingmetrics configuration properties:
382565315LogTimer usage in SecurityPolicy could cause a memory leak.
v1.13.3
Security

Stricter class instantiation checks included in this release.

JavaCallout policy now includes additional security during Java class instantiation. The enhanced security measure prevents the deployment of policies that directly or indirectly attempt actions that require permissions that are not allowed.

In most cases, existing policies will continue to function as expected without any issues. However, there is a possibility that policies relying on third-party libraries, or those with custom code that indirectly triggers operations requiring elevated permissions, could be affected.

To test your installation, follow the procedure inValidate policies after upgrade to 1.13.3 to validate policy behavior.

Bug IDDescription
Bug IDDescription
385394193,383850393,383778273Security fixes forapigee-cassandra-backup-utility,apigee-cassandra-client, andapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
382967738Fixed a vulnerability in PythonScript policy.
N/ASecurity fixes forapigee-envoy.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerability:
392174215Security fixes forapigee-operator.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
391786033Security fixes forapigee-watcher.
This addresses the following vulnerability:
N/ASecurity fixes forlivenessprobe.
This addresses the following vulnerability:
388271708Security fix for Apigee infrastructure

This addresses the following vulnerability:

  • CVE-2025-13426

    Fixed an issue with the JavaCallout policy that could result in remote code execution.

v1.13.3
Announcement

Manage process ID limits

The procedure to manage the process ID limits in your clusters has been added to the documentation.

A Process ID limit is a Kubernetes resource constraint on nodes and pods to prevent excessive process creation, which can impact node stability. Setting process ID limits in Kubernetes can improve system stability, security, and resource management. This is also consistent with Kubernetes best practices. Apigee Hybrid supports the Kubernetes feature to set process ID limits.

See:Manage process ID limits.

v1.12.4
Announcement

hybrid v1.12.4

On March 1, 2025 we released an updated version of the Apigee hybrid software, 1.12.4.

This release enhances the security posture within theJavaCallout andPythonScript policies. This release does not include any new features or general bug fixes.

v1.12.4
Fixed
Bug IDDescription
390258745,388608440Any left over Cassandra snapshots are automatically removed. This fixesknown issue 388608440.
v1.12.4
Security

Stricter class instantiation checks included in this release.

JavaCallout policy now includes additional security during Java class instantiation. The enhanced security measure prevents the deployment of policies that directly or indirectly attempt actions that require permissions that are not allowed.

In most cases, existing policies will continue to function as expected without any issues. However, there is a possibility that policies relying on third-party libraries, or those with custom code that indirectly triggers operations requiring elevated permissions, could be affected.

To test your installation, follow the procedure inValidate policies after upgrade to 1.12.4 to validate policy behavior.

Bug IDDescription
391923260Security fixes forapigee-watcher.
This addresses the following vulnerabilities:
385394193,383850393,383778273Security fixes forapigee-cassandra-backup-utility,apigee-cassandra-client, andapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
382967738Fixed a vulnerability in PythonScript policy.
365178914Security fixes forapigee-cassandra-backup-utility andapigee-hybrid-cassandra.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-udca.
This addresses the following vulnerability:
388271708Security fix for Apigee infrastructure

This addresses the following vulnerability:

  • CVE-2025-13426

    Fixed an issue with the JavaCallout policy that could result in remote code execution.

January 09, 2025

1.14.0-hotfix.1
Announcement

hybrid 1.14.0-hotfix.1

On January 9, 2025 we released an updated version of the Apigee hybrid software, 1.14.0-hotfix.1.

Note: This release only affects theapigee-telemetry chart.

Instructions:

To install 1.14.0-hotfix.1:

  1. In youroverrides.yaml file update the value ofmetrics.sdSidecar.image.tag to0.10.0. Add the following stanza:

    metrics:sdSidecar:image:url:"gcr.io/apigee-release/hybrid/apigee-stackdriver-prometheus-sidecar"tag:"0.10.0"
  2. Apply the changes to theapigee-telemetry chart:

    1. Dry run:

      helm upgrade telemetry apigee-telemetry/ \  --install \  --namespace APIGEE_NAMESPACE \  --atomic \  -f overrides.yaml \  --dry-run=server
    2. Install the chart:

      helm upgrade telemetry apigee-telemetry/ \  --install \  --namespace APIGEE_NAMESPACE \  --atomic \  -f overrides.yaml
    3. Verify the change by checking its state:

      kubectl -n APIGEE_NAMESPACE get apigeetelemetry apigee-telemetry

December 16, 2024

v1.14.0
Feature

Enhanced Per-environment Proxy Limits in Apigee Hybrid

Starting in version v1.14, new Apigee hybrid organizations can be provisioned with the ability to deploy more than 50 proxies per environment enabled. This feature is already available forApigee X.

Starting with Apigee hybrid version 1.14, the limits for Apigee hybrid organizations have increased:

  • The maximum number of deployed API proxies and shared flows per organization is 6000.
  • The maximum number of proxy deployment units per Apigee instance is 6000.
  • The maximum number of API base paths per Apigee organization is 3000.

When more than 50 proxies are deployed in an environment, Apigee will automatically partition the environment into several distinct replica sets, each containing a subset of proxies deployed in the environment. These replica subsets are equivalent in behavior and infrastructure resource usage to a single environment in the way it loads and runs a set of proxies and other environment resources. This will be transparent to the user, and you can continue to use the environment as you would a single environment.

Note: Enhanced per-environment proxy limits are only available for new hybrid organizations with the entitlement for the feature included inSubscription 2024. Enhanced per-environment proxy limits are not available in upgraded organizations.

See:

v1.14.0
Feature

Forward Proxy allowlist access

Starting in version v1.14, forward proxies pass through access to allowlisted URLs. Therefore you only need to configure allowlists to googleapis.com URLs on the server on which the forward proxy is configured. See:

v1.14.0
Feature

Guardrails checks to ensure backups before upgrade

Starting in version 1.14 new guardrails checks have been added to ensure a backup is enabled and has been made before proceeding with an upgrade. See:

v1.14.0
Feature

Enable and disable metrics-based scaling withcustomAutoscaling.enabled

Starting in version v1.14, you can enable and disable metrics-based auto-scaling with thecustomAutoscaling.enabled configuration property. See:

v1.14.0
Feature

Cassandra credential rotation

Starting in version v1.14, you can rotate Cassandra credentials in Kubernetes secrets. In addition, you can now roll back credential rotation before the cleanup job is initiated in both Vault and Kubernetes secrets. See:

v1.14.0
Feature

New analytics and debug data pipeline for hybrid orgs

Starting with version 1.14, Apigee hybrid orgs can use a new data pipeline to collect analytics and debug data and allow various runtime components to write data directly to our control plane. Control plane access is required to enable the new data pipeline.

See:

v1.14.0
Fixed
Bug IDDescription
382323427Added a guardrails check that requires backup to be enabled for Apigee Hybrid upgrades. Backups are required prior to upgrading to support restoring to the previous version, if necessary.
380346557Added a guardrails check that requires the backup within the last 24 hours to be present if the CSI backup is enabled. This will minimize potential data loss if a restore to the previous version is needed.
377573589Fix a bug where manually created rollbacks would interfere with existing rotations instead of cancelling them.
362305438Users can now add additional env variables to the runtime component. Seeruntime.envVars
319152386FixAccessTokenGenerationFailure in runtime when using a forward proxy.
335357961Fixed an issue where Apigee hybrid could claim uploads of backups with the Cloud provider when no bucket had been configured
290183372The need to allowlist oauth2 and iamcredentials.googleapis.com directly from MP in fwd proxy setup is removed.
237656263Resolved issue with ServiceCallout policy not working in async mode as expected.
373722434Fixed support for backups to Google Cloud Storage buckets with retention policies. (Fixed inv1.13.2)
368646378Fixed an issue affecting control Plane connectivity testing in Guardrails. (Fixed inv1.12.3)
364282883Remove check for dc-expansion flag and add timeout to multi-region seed host connection test. (Fixed inv1.13.1)
362979563Fix for Ingress Health Check failure/healthz/ingress - route_not_found. (Fixed in1.13.0-hotfix.1)
362690729Fix for aggressive scaling of runtime pods & cpu spike. (Fixed in1.13.0-hotfix.1)
362305438You can now add additional env variables to the runtime component. (Fixed inv1.13.1)
361044374Fixes assign message not correctly highlighting the set payload action in the debug trace. (Fixed inv1.13.2)
355122464This release contains a few error-handling fixes for CSI backup and restore. (Fixed inv1.13.2)
353527851WebSocket connection drops when usingVerifyJwt orOAuthV2 VerifyJWTAccessToken operations. (Fixed inv1.13.1)
351440306An issue was fixed where trace could not be viewed in the UI for orgs with DRZ enabled. (Fixed inv1.13.1)
347798999You can now configure forward proxy for opentelemetry pods in Apigee hybrid. (Fixed inv1.12.2)
338638343An ID is now added at the end ofapigee-env andvirtualhost guardrails pods to make the pod names unique. (Fixed inv1.13.1)
237656263Fix added to make use of asynchronous ServiceCallout execution when theServiceCallout policy <Response> element is not present (Fixed inv1.13.2)
181569113Fixed an issue in new debug session creation. (Fixed inv1.12.3)
v1.14.0
Security
Bug IDDescription
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forlivenessprobe.
This addresses the following vulnerability:
376104926Security fixes forapigee-kube-rbac-proxy. (Fixed inv1.12.3)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-redis. (Fixed inv1.13.2)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector. (Fixed inv1.13.1)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-open-telemetry-collector. (Fixed inv1.12.3)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-cassandra-backup-utility andapigee-hybrid-cassandra. (Fixed inv1.12.2)
This addresses the following vulnerability:

November 12, 2024

v1.13.2
Announcement

hybrid v1.13.2

On November 12, 2024 we released an updated version of the Apigee hybrid software, 1.13.2.

v1.13.2
Security
Bug IDDescription
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
v1.13.2
Fixed
Bug IDDescription
373722434Fixed support for backups to GCS buckets with retention policies.
361044374Fixes assign message not correctly highlighting the set payload action in the debug trace.
355122464This release contains a few error-handling fixes for CSI backup and restore.
237656263Fix added to make use of asynchronous ServiceCallout execution when theServiceCallout policy <Response> element is not present.

Procedure:

  1. In theapigee-env/values.yaml file setconf_system_servicecallout.expects.response tofalse underruntime:cwcAppend:. For example:
    # Apigee Runtime.runtime:  cwcAppend:    conf_system_servicecallout.expects.response: false
  2. Upgrade theapigee-env chart for each environment to apply the change. For example:
    helm upgradeENV_RELEASE_NAME apigee-env/ \  --install \  --namespaceAPIGEE_NAMESPACE \  --set env=ENV_NAME \  -fOVERRIDES_FILE

November 01, 2024

v1.12.3
Announcement

hybrid v1.12.3

On November 1, 2024 we released an updated version of the Apigee hybrid software, 1.12.3.

v1.12.3
Fixed
Bug IDDescription
368646378Fixed an issue affecting control Plane connectivity testing in Guardrails.
361044374Fixes assign message not correctly highlighting the set payload action in the debug trace.
335357961Fixed an issue where Apigee hybrid could claim uploads of backups with the Cloud provider when no bucket had been configured
181569113Fixed an issue in new debug session creation.
v1.12.3
Security
Bug IDDescription
376104926Security fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerability:

October 04, 2024

v1.13.1
Announcement

hybrid v1.13.1

On October 4, 2024 we released an updated version of the Apigee hybrid software, 1.13.1.

v1.13.1
Feature

New analytics and debug data pipeline for data residency-enabled orgs

Starting in v1.13.1 hybrid organizations created with data residency enabled must use the new data pipeline to collect analytics and debug data and allow various runtime components to write data directly to our control plane. Changes to overrides file and control plane access are required to enable the new data pipeline.

For details, see:

Note: The new data pipeline is only supported for data residency enabled organizations in versions 1.13.x. It is supported for non-data residency enabled organizations starting inApigee hybrid version 1.14.0.
v1.13.1
Feature

Cassandra credential rotation in Vault

Starting in version v1.3.1, You can set up automatic Cassandra credential rotation when your credentials are stored in Hashicorp Vault. SeeRotating Cassandra credentials in Hashicorp Vault.

v1.13.1
Fixed
Bug IDDescription
364282883Remove check for dc-expansion flag and add timeout to multi-region seed host connection test.
362305438You can now add additional env variables to the runtime component.
353527851WebSocket connection drops when usingVerifyJwt orOAuthV2 VerifyJWTAccessToken operations.
351440306An issue was fixed where trace could not be viewed in the UI for orgs with DRZ enabled.
338638343An ID is now added at the end ofapigee-env andvirtualhost guardrails pods to make the pod names unique.
v1.13.1
Security
Bug IDDescription
N/ASecurity fixes forapigee-open-telemetry-collector.
This addresses the following vulnerability:

September 13, 2024

v1.12.2
Announcement

hybrid v1.12.2

On September 13, 2024 we released an updated version of the Apigee hybrid software, 1.12.2.

v1.12.2
Fixed
Bug IDDescription
362305438You can now add additional env variables to the runtime component.
347798999You can now configure forward proxy for opentelemetry pods in Apigee hybrid.
v1.12.2
Security
Bug IDDescription
N/ASecurity fixes forapigee-cassandra-backup-utility andapigee-hybrid-cassandra.
This addresses the following vulnerability:

September 05, 2024

1.13.0-hotfix.1
Announcement

hybrid 1.13.0-hotfix.1

On September 5, 2024 we released an updated version of the Apigee hybrid software, 1.13.0-hotfix.1.

Apply this hotfix following the steps inUpgrading Apigee hybrid to version 1.13:

  1. Prepare for the Helm charts upgrade
  2. Install the Apigee hybrid Helm charts
1.13.0-hotfix.1
Fixed
Bug IDDescription
362690729Fix for aggressive scaling of runtime pods & cpu spike.
362979563Fix for Ingress Health Check failure/healthz/ingress - route_not_found.

August 23, 2024

v1.13.0
Announcement

hybrid v1.13.0

On August 23, 2024 we released an updated version of the Apigee hybrid software, v1.13.0.

v1.13.0
Feature

Storing additional secrets in an external secret store

Starting in version v1.13, You can now store AX Hash Salt, Redis password, and Encryption keys in an external secret store like Hashicorp Vault. SeeStoring Secrets in Vault.

v1.13.0
Feature

Apigee Operator now runs in the Apigee Kubernetes namespace

Starting in version v1.13,apigee-operator runs in the same name space as the other Apigee hybrid components instead of theapigee-system namespace. You can useapigee or your own custom Apigee namespace. SeeUpgrading Apigee hybrid to version v1.13.0 andStep 3: Create the apigee namespace.

v1.13.0
Feature

Leader election enabled forapigee-watcher component

Starting in version v1.13.0, leader election is enabled for theapigee-watcher component. For proper functioning of the leader election, make sure that theapigee-watcher component uses only one replica set.

v1.13.0
Feature

Improved backup and restore

Starting in version v1.13.0, Apigee hybrid introduces a new backup and restore system. The new system removes the need for pod exec permission and use of a Kubernetes ClusterRole, and requires fewer Kubernetes Service Accounts when using Workload Identity. The new system replaces use of the apigee-cassandra-backup-utility image by using the apigee-hybrid-cassandra-client image. The apigee-cassandra-backup-utility image will no longer be provided starting with this release.

To use the new functionality if you are overriding the image used, update youroverrides.yaml file.

Replace:

  • repo.sample.com/gcr-docker/apigee-release/hybrid/apigee-cassandra-backup-utility

with

  • repo.sample.com/gcr-docker/apigee-release/hybrid/apigee-hybrid-cassandra-client

undercassandra.backup.image.url andcassandra.restore.image.url.

SeeScheduling backups in a remote server for more information.

v1.13.0
Fixed
Bug IDDescription
352070616Update Go language version.
351868444Tolerations are now working for Redis's Envoy pod. (Fixed in 1.12.1-hotfix.1)
347997965Upgrading to Apigee Hybrid 1.11.2 and 1.10.5 can cause missing metrics. (Fixed in 1.11.2-hotfix.1)
347798999Fixed issue preventing configuration of forward proxy foropentelemetry pods. (Fixed in Apigee hybrid v 1.12.1)
346589998Check Cassandra DNS hostname resolution during Hybrid region expansion.
345501069Fixed issue with Hybrid Guardrails resource configuration preventing the Guardails pod from starting. (Fixed in Apigee hybrid v 1.12.1)
341797795Autofill the Hybrid Guardrails checkpoint value if a checkpoint is not provided. (Fixed in Apigee hybrid v 1.12.1)
340889560Addedcsi to theapigee-logger SCC. (Fixed in Apigee hybrid v 1.12.0-hotfix.1)
340248314Added support fortargetCPUUtilizationPercentage toapigeeIngressGateway andingressGateways. The default value is 75. (Fixed in Apigee hybrid v 1.12.1)
339849002Hashicorp Vault integration issues fixed for Google Service Account for Cassandra Backup/Restore. (Fixed in Apigee hybrid v 1.12.0-hotfix.1)
324779388Improved error handling for backup and restore. (Fixed in Apigee hybrid v 1.12.1)
311489774Removed inclusion of Java in Cassandra client image.. (Fixed in Apigee hybrid v 1.12.1)
310338146Fixed invalid download directory output from thecreate-service-account tool. (Fixed in Apigee hybrid v 1.12.1)
300135626Removed inclusion of Java in Cassandra Backup Utility image. (Fixed in Apigee hybrid v 1.12.1)
297539870HTTPTargetConnection propertyio.timeout.millis is now honored correctly when using websockets. (Fixed in 1.11.2-hotfix.2)
239523766Remove "Unable to evaluate jsonVariable, returning null" logging string fromExtractVariables Policy (Fixed in Apigee hybrid v 1.12.1)
181569113Fixed an issue in new debug session creation. (Fixed in Apigee hybrid v 1.11.2)
v1.13.0
Security
Bug IDDescription
N/ASecurity fixes forapigee-asm-istiod.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-cassandra-backup-utility.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-connect-agent.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-envoy.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-operators.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prom-prometheus.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-udca.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-watcher.
This addresses the following vulnerability:
N/ASecurity fixes forcassandra-backup-utility.
This addresses the following vulnerability:

July 31, 2024

1.11.2-hotfix.2
Announcement

hybrid 1.11.2-hotfix.2

On July 31, 2024 we released an updated version of the Apigee hybrid software, 1.11.2-hotfix.2.

Note: This release reflects a change to the component images and not the Helm chart templates. If your hybrid installation is currently on Apigee hybrid v1.11.2, Apply this hotfix with the following steps:

  1. In your overrides file, update theimage.url andimage.tag properties ofao andruntime:

    ao:image:url:"gcr.io/apigee-release/hybrid/apigee-operators"tag:"1.11.2-hotfix.2"runtime:image:url:"gcr.io/apigee-release/hybrid/apigee-runtime"tag:"1.11.2-hotfix.2"
  2. Install the hotfix release:

    • For Helm-managed releases, update theapigee-operator with thehelm upgrade command and your current overrides files:

      helm upgrade operator apigee-operator/ \  --namespace apigee-system \  --atomic \  -f overrides.yaml

      For each environment in your Apigee org:

      helm upgrade ENV_RELEASE_NAME apigee-env/ \  --namespace APIGEE_NAMESPACE \  --set env=ENV_NAME \  --atomic \  -f overrides.yaml
      • ENV_RELEASE_NAME is a name used to keep track of installation and upgrades of theapigee-env chart. This name must be unique from the other Helm release names in your installation. Usually this is the same asENV_NAME. However, if your environment has the same name as your environment group, you must use different release names for the environment and environment group, for exampledev-env-release anddev-envgroup-release. For more information on releases in Helm, seeThree big concepts in the Helm documentation.
      • APIGEE_NAMESPACE is your installation's namespace. The default isapigee.
      • ENV_NAME is the name of the environment you are upgrading.
    • Forapigeectl-managed releases:

      1. install the hotfix release withapigeectl init using your updated overrides file:

        ${APIGEECTL_HOME}/apigeectlinit-fOVERRIDES_FILE--dry-run=client

        Followed by:

        ${APIGEECTL_HOME}/apigeectlinit-fOVERRIDES_FILE
      2. Apply the hotfix release withapigeectl apply:

        ${APIGEECTL_HOME}/apigeectlapply-fOVERRIDES_FILE--all-envs--dry-run=client

        Followed by:

        ${APIGEECTL_HOME}/apigeectlapply-fOVERRIDES_FILE--all-envs
1.11.2-hotfix.2
Fixed
Bug IDDescription
351868444Tolerations are now working for Redis's Envoy pod.
297539870HTTPTargetConnection propertyio.timeout.millis is now honored correctly when using websockets.

July 30, 2024

1.12.1-hotfix.1
Announcement

hybrid 1.12.1-hotfix.1

On July 30, 2024 we released an updated version of the Apigee hybrid software, 1.12.1-hotfix.1.

Note: This release reflects a change to the component images and not the Helm chart templates. If your hybrid installation is currently on Apigee hybrid v1.12.1, Apply this hotfix with the following steps:

  1. In your overrides file, update theao.image.url andao.image.tag properties:

    ao:image:url:"gcr.io/apigee-release/hybrid/apigee-operators"tag:"1.12.1-hotfix.1"
  2. Install the hotfix release. Update theapigee-operator component with thehelm upgrade command and your current overrides files:

       helm upgrade operator apigee-operator/ \     --namespace apigee-system \     --atomic \     -f overrides.yaml
1.12.1-hotfix.1
Fixed
Bug IDDescription
351868444Tolerations are now working for Redis's Envoy pod.

June 28, 2024

v1.12.1
Announcement

hybrid v1.12.1

On June 28, 2024 we released an updated version of the Apigee hybrid software, 1.12.1.

1.11.2-hotfix.1
Announcement

hybrid 1.11.2-hotfix.1

On June 28, 2024 we released an updated version of the Apigee hybrid software, 1.11.2-hotfix.1.

Note: This release reflects a change to the Helm chart templates and not a change to the images. If your hybrid installation is currently on Apigee hybrid v1.11.2, Apply this hotfix with the following steps:

  1. In your overrides file, update theao.imageurl andtag:

    ao:image:url:"gcr.io/apigee-release/hybrid/apigee-operators"tag:"1.11.2-hotfix.1"
  2. Install the hotfix release:

    • For Helm-managed releases, update theapigee-operator with thehelm upgrade command and your current overrides files:

      helm upgrade operator apigee-operator/ \  --namespace apigee-system \  --atomic \  -f overrides.yaml
    • Forapigeectl-managed releases, install the hotfix release withapigeectl init using your updated overrides files:

      ${APIGEECTL_HOME}/apigeectlinit-fOVERRIDES_FILE--dry-run=client

      Followed by:

      ${APIGEECTL_HOME}/apigeectlinit-fOVERRIDES_FILE
1.10.5-hotfix.1
Announcement

hybrid 1.10.5-hotfix.1

On June 28, 2024 we released an updated version of the Apigee hybrid software, 1.10.5-hotfix.1.

Note: This release reflects a change to the Helm chart templates and not a change to the images. If your hybrid installation is currently on Apigee hybrid v1.10.5, Apply this hotfix with the following steps:

  1. In your overrides file, update theao.imageurl andtag:

    ao:image:url:"gcr.io/apigee-release/hybrid/apigee-operators"tag:"1.10.5-hotfix.1"
  2. Install the hotfix release withapigeectl init using your updated overrides files:

    ${APIGEECTL_HOME}/apigeectlinit-fOVERRIDES_FILE--dry-run=client

    Followed by:

    ${APIGEECTL_HOME}/apigeectlinit-fOVERRIDES_FILE
v1.12.1
Fixed
Bug IDDescription
347798999Fixed an issue preventing configuration of forward proxies for OpenTelemetry collector pods.
345501069Fixed issue with Hybrid Guardrails resource configuration preventing the Guardails pod from starting.
341797795Autofill the Hybrid Guardrails checkpoint value if a checkpoint is not provided.
340248314Added support fortargetCPUUtilizationPercentage toapigeeIngressGateway andingressGateways. The default value is 75.
324779388Improved error handling for backup and restore.
311489774Removed inclusion of Java in Cassandra client image..
310338146Fixed invalid download directory output from thecreate-service-account tool.
300135626Removed inclusion of Java in Cassandra Backup Utility image.
239523766Remove "Unable to evaluate jsonVariable, returning null" logging string fromExtractVariables Policy
1.10.5-hotfix.1
Fixed
Bug IDDescription
347997965Upgrading to Apigee Hybrid 1.11.2 and 1.10.5 can cause missing metrics.
v1.12.1
Security
Bug IDDescription
345791712Security fix forfluent-bit.
This addresses the following vulnerability:
335910066Security fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerability:
335909737Security fixes forapigee-asm-ingress.
This addresses the following vulnerabilities:
335909397Security fixes forapigee-open-telemetry-collector.
This addresses the following vulnerability:
335908990Security fixes forapigee-asm-istiod.
This addresses the following vulnerabilities:
335908985Security fix forapigee-prometheus-adapter.
This addresses the following vulnerabilities:.
335908657Security fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
335908139Security fix forfluent-bit.
This addresses the following vulnerability:
332821083Security fix forapigee-operators.
This addresses the following vulnerability:
317528509Security fixes forapigee-synchronizer.
This addresses the following vulnerabilities:
308835165Security fix forapigee-synchronizer.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-ingress.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-asm-istiod.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-cassandra-backup-utility.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-stackdriver-prometheus-sidecar.
This addresses the following vulnerabilities:

June 17, 2024

v1.10.5
Announcement

hybrid v1.10.5

On June 17, 2024 we released an updated version of the Apigee hybrid software, 1.10.5.

v1.10.5
Security
Bug IDDescription
329540114Security fix forapigee-installer.
This addresses the following vulnerability:
317528509Security fix forapigee-synchronizer.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-synchronizer.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-asm-ingress andapigee-asm-istiod.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-cassandra-backup-utility.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-connect-agent.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-diagnostics-collector.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-runtime.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-udca.
This addresses the following vulnerabilities:

June 10, 2024

v1.11.2
Announcement

hybrid v1.11.2

On June 10, 2024 we released an updated version of the Apigee hybrid software, 1.11.2.

v1.11.2
Fixed
Bug IDDescription
340248314Added support fortargetCPUUtilizationPercentage toapigeeIngressGateway andingressGateways for hybrid installations managed with Helm. The default value is 75.
Note:targetCPUUtilizationPercentage is not supported forapigeectl.
324779388Improved error handling for backup and restore.
311489774Removed inclusion of Java and Python installations in Cassandra client image.
300135626Removed inclusion of Java and Python installations in Cassandra Backup Utility image.
181569113Fixed an issue in new debug session creation.
v1.11.2
Security
Bug IDDescription
345520525Security fixes forapigee-asm-ingress. andapigee-asm-istiod.
This addresses the following vulnerabilities:
335908139Security fixes forapigee-fluent-bit.
This addresses the following vulnerability:
333121802Security fixes forapigee-cassandra-backup-utility. andapigee-hybrid-cassandra.
This addresses the following vulnerability:
317528509Security fix forapigee-synchronizer.
This addresses the following vulnerabilities:
317447390Security fix forapigee-operators.
This addresses the following vulnerability:
329762216Security fix forapigee-installer.
This addresses the following vulnerability:
308835165Security fixes forapigee-synchronizer.
This addresses the following vulnerability:
308926079Security fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
300091388Security fixes for Apigee Connect Agent.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-cassandra-backup-utility.
This addresses the following vulnerability:
N/ASecurity fixes forapigee-diagnostics-collector.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mart-server.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-mint-task-scheduler.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-redis.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-runtime.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-synchronizer.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-udca.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-watcher.
This addresses the following vulnerabilities:

May 28, 2024

1.12.0-hotfix.1
Announcement

ANNOUNCEMENT

hybrid 1.12.0-hotfix.1

On May 28, 2024 we released an updated version of the Apigee hybrid software, 1.12.0-hotfix.1.

Note: This release reflects a change to the Helm chart templates and not a change to the images. If your hybrid installation is currently on Apigee hybrid v1.12.0, you can install this hotfix release by downloading the charts with the version tag1.12.0-hotfix.1 and updating theapigee-operator andapigee-datastore charts with thehelm upgrade command and your current overrides files.

For example:

exportCHART_REPO=oci://us-docker.pkg.dev/apigee-release/apigee-hybrid-helm-chartsexportCHART_VERSION=1.12.0-hotfix.1helmpull$CHART_REPO/apigee-operator--version$CHART_VERSION--untarhelmpull$CHART_REPO/apigee-datastore--version$CHART_VERSION--untar
helm upgrade operator apigee-operator/ \  --namespace apigee-system \  --atomic \  -f overrides.yamlhelm upgrade datastore apigee-datastore/ \  --namespace apigee \  --atomic \  -f overrides.yaml
1.12.0-hotfix.1
Fixed
Bug IDDescription
340889560Addedcsi to theapigee-logger SCC.
339849002Hashicorp Vault integration issues fixed for Google Service Account for Cassandra Backup/Restore.

April 17, 2024

v1.12.0
Announcement

hybrid v1.12.0

On April 17, 2024 we released an updated version of the Apigee hybrid software, v1.12.0.

For information on upgrading, seeUpgrading Apigee hybrid to version v1.12.0.For information on new installations, seeThe big picture.

v1.12.0
Feature

Hybrid 1.12 validates required conditions are satisfied before allowing Runtime services to be created. SeeDiagnosing issues with guardrails.

v1.12.0
Feature

The JAR file dependencies required to create aJava callout are now hosted securely in ArtifactRegistry.

For more information on downloading the JAR dependencies from Artifact Regsitry, seeCompile your code with Maven.

v1.12.0
Feature

A new suite of metrics for monitoring Apigee proxies and target endpoints is now available for Hybrid 1.12.

v1.12.0
Feature

Hybrid v1.12 now supports storing service account keys in Hashicorp Vault. SeeStoring service account keys in Hashicorp Vault.

v1.12.0
Feature

You can now add your owncontractEncryptionKey for new Apigee hybrid installations. For details, seeData encryption.

v1.12.0
Feature

Apigee hybrid now supports Workload Identity Federation for component authentication on AKS and EKS installations. SeeEnabling Workload Identity Federation on AKS and EKS.

v1.12.0
Deprecated

TheProxyv2 andtargetv2 metrics suite is deprecated. The Apigee hybrid v1.12 release supports thenew proxy and target metrics by default. Support forProxyv2 andtargetv2 metrics in hybrid v 1.10 and v1.11 will end on April 17, 2025. For more information, seeProxyV2 and TargetV2 deprecation.

v1.12.0
Deprecated

Theapigeectl command-line tool is deprecated. as of April 17, 2024. Theapigeectl tool is not supported for Apigee hybrid v1.12. Support forapigeectl for hybrid v1.10 and v1.11 will end on April 17, 2025. For more information, seeapigeectl deprecation.

v1.12.0
Security

These security bugs were fixed in Apigee hybrid v1.12.0

Bug IDDescription
N/ASecurity fixes forapigee-cassandra-backup-utility
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra-client
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prometheus-adapter
This addresses the following vulnerability:
N/ASecurity fixes forapigee-udca
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-watcher
This addresses the following vulnerability:
N/ASecurity fixes forapigee-connect-agent
This addresses the following vulnerability:
N/ASecurity fixes forapigee-fluent-bit
This addresses the following vulnerabilities:
v1.12.0
Fixed
Bug IDDescription
284034011Modified Apigee Watcher and Apigee Ingress to leverage a sidecar instead of pod/exec for collecting ingress routing status.
298202120The Datastore component now uses Cassandra 4.
311705715Use a non-default service account for theremove-dc component. (Fixed in Apigee hybrid 1.10.3-hotfix.4, 1.10.4, and 1.11.1)
306341401Fixed regression where virtualhost cipherSuites overrides weren't being used. (Fixed in Apigee hybrid 1.10.4 and 1.11.1)
302186503Added the missing HTTP proxy template settings to the Apigee Hybrid Helmdatastore component. (Fixed in Apigee hybrid 1.10.4)
300542690Added dedicated service accounts for Apigee Connect, Redis, and UDCA to prevent Kubernetes from automatically injecting credentials for a specified Service Account or the default Service Account. (Fixed in Apigee hybrid 1.10.4)
277353680Fixed issue causing target server HealthMonitors to continue beyond revision or deletion of the proxy.

Target health checks are now terminated as soon as the proxy is removed from the runtime (undeployed or deleted). Note: There may be a delay between removal of the proxy and termination of the target server health checks. (Fixed in Apigee hybrid 1.10.4)

v1.12.0
Security

These security bugs were fixed in Apigee hybrid v1.11.1-hotfix.1.

Bug IDDescription
324460830Security fix for apigee-ingress.
This addresses the following vulnerabilities:
v1.12.0
Security

These security bugs were fixed in Apigee hybrid v1.10.4-hotfix.1.

Bug IDDescription
324460830Security fix for apigee-ingress.
This addresses the following vulnerabilities:
v1.12.0
Security

These security bugs were fixed in Apigee hybrid v1.10.4.

Bug IDDescription
315034009Security fixes:apigee-asm-ingress andapigee-asm-istiod (ingressgateway andingressgateway-controller) are upgraded to Service Mesh version 1.17.8-asm.4.
This addresses the following vulnerabilities:
311167948A security issue was addressed.
303460289Security fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
303459588Security fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
300319489Security fixes forfluentd.
This addresses the following vulnerabilities:
294892189Security fixes forapigee-diagnostics-collector.
This addresses the Guava vulnerability:
N/ASecurity fixes forapigee-cassandra-backup-utility andapigee-prom-prometheus.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra andapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-installer,apigee-operators, andapigee-watcher.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
v1.12.0
Security

These security bugs were fixed in Apigee hybrid v1.11.1.

Bug IDDescription
315034009Security fixes:apigee-asm-ingress andapigee-asm-istiod (ingressgateway andingressgateway-controller) are upgraded to Service Mesh version 1.17.8-asm.4.
This addresses the following vulnerabilities:
303460289Security fixes toapigee-prometheus-adapter.
This addresses the following vulnerabilities:
303459588Security fixes toapigee-prom-prometheus.
This addresses the following vulnerabilities:
303292806Restrict connections from the Cassandra backup utility to Cassandra server pods in theapigee namespace.
N/ASecurity fixes toapigee-cassandra-backup-utility.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-installer,apigee-operators, andapigee-watcher.
This addresses the following vulnerabilities:

February 09, 2024

1.10.4-hotfix.1
Announcement

hybrid 1.10.4-hotfix.1

On February 9, 2024 we released an updated version of the Apigee hybrid software, v1.10.4-hotfix.1.

This release addresses the security concerns inGCP-2024-007 from Google Anthos Service Mesh.

Note: This hotfix installs theapigee-ingress container image. All other container images are unchanged from Hybrid v1.10.4.

December 21, 2023

v1.11.1
Fixed
Bug IDDescription
311705715Use a non-default service account for theremove-dc component.
306341401Fixed regression where virtualhost cipherSuites overrides weren't being used.
v1.11.1
Security
Bug IDDescription
315034009Security fixes:apigee-asm-ingress andapigee-asm-istiod (ingressgateway andingressgateway-controller) are upgraded to Service Mesh version 1.17.8-asm.4.
This addresses the following vulnerabilities:
303460289Security fixes toapigee-prometheus-adapter.
This addresses the following vulnerabilities:
303459588Security fixes toapigee-prom-prometheus.
This addresses the following vulnerabilities:
303292806Restrict connections from the Cassandra backup utility to Cassandra server pods in theapigee namespace.
N/ASecurity fixes toapigee-cassandra-backup-utility.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:
N/ASecurity fixes toapigee-installer,apigee-operators, andapigee-watcher.
This addresses the following vulnerabilities:

December 18, 2023

v1.10.4
Announcement

hybrid v1.10.4

On December 18, 2023 we released an updated version of the Apigee hybrid software, 1.10.4.

v1.10.4
Fixed
Bug IDDescription
311705715Use a non-default service account for theremove-dc component.
306341401Fixed regression where virtualhost cipherSuites overrides weren't being used.
302186503Add the missing HTTP proxy template settings to the Apigee Hybrid Helmdatastore component.
300542690Added dedicated service accounts for Apigee Connect, Redis, and UDCA to prevent Kubernetes from automatically injecting credentials for a specified Service Account or the default Service Account.
277353680Fixed issue causing target server HealthMonitors to continue beyond revision or deletion of the proxy.

Target health checks are now terminated as soon as the proxy is removed from the runtime (undeployed or deleted). Note: There may be a delay between removal of the proxy and termination of the target server health checks.

v1.10.4
Security
Bug IDDescription
315034009Security fixes:apigee-asm-ingress andapigee-asm-istiod (ingressgateway andingressgateway-controller) are upgraded to Service Mesh version 1.17.8-asm.4.
This addresses the following vulnerabilities:
311167948A security issue was addressed.
303460289Security fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:
303459588Security fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
300319489Security fixes forfluentd.
This addresses the following vulnerabilities:
294892189Security fixes forapigee-diagnostics-collector.
This addresses the Guava vulnerability:
N/ASecurity fixes forapigee-cassandra-backup-utility andapigee-prom-prometheus.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra andapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-installer,apigee-operators, andapigee-watcher.
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy.
This addresses the following vulnerabilities:

December 01, 2023

1.10.3-hotfix.4
Announcement

hybrid 1.10.3-hotfix.4

On December 1, 2023 we released an updated version of the Apigee hybrid software, v1.10.3-hotfix.4.

Note: This hotfix installs theapigee-hybrid-cassandra andapigee-operator container images. All other container images are unchanged fromHybrid v1.10.3-hotfix.3.
1.10.3-hotfix.4
Fixed
Bug IDDescription
311705715Mount a dedicated service account to theremove-dc component.
1.10.3-hotfix.4
Security
Bug IDDescription
311167948A security issue was addressed.

November 17, 2023

v1.11.0
Announcement

hybrid v1.11.0

On November 17, 2023 we released an updated version of the Apigee hybrid software, v1.11.0.

v1.11.0
Feature

Vault integration for Cassandra credentials (preview)

Starting in version v1.11.0, you can store Cassandra credentials in Hashicorp Vault.
Note: Using Vault requires Helm management of your Apigee installation.
SeeStoring Cassandra credentials in Hashicorp Vault.

Vault integration is in preview as of the Apigee hybrid 1.11.0 release.

v1.11.0
Feature

With this release, theHeaderName element is available as a child element ofAuthentication. This element appears in theServiceCallout andExternalCallout policies, and in theTargetEndpoint proxy configuration.

By default, when anAuthentication configuration is present, Apigee generates and injects a bearer token into theAuthorization header, in the message sent to the target system. The newHeaderName element allows you to specify the name of a different header to hold that bearer token.

v1.11.0
Feature

Apigee Advance API Security Actions for Apigee hybrid

Advanced API Security's newSecurity Actions feature is now available in Apigee hybrid.

v1.11.0
Feature

Helm charts management for Apigee hybrid

Starting in version v1.11.0, you have the choice of installing and managing your clusters with either Helm orapigeectl. You cannot manage a cluster with both. Apigee recommends using Helm for new hybrid installations. SeeApigee hybrid Helm charts reference.

v1.11.0
Fixed
Bug IDDescription
295929616Installation of Hybrid 1.10.x would fail on OpenShift due to out of memory issues. (Fixed in Apigee hybrid v1.10.3)
294069799Updated the security context settings for the Apigee Hybrid Backup and Restore pod.
292571089An error with support for CSI backup and restore for Cassandra was fixed. (Fixed in Apigee hybrid v1.10.3)
292118812Fixed UDCA regression in Hybrid 1.10.1 where UDCA would ignore forward proxy configuration. (Fixed in Apigee hybrid v1.10.2)
289254725Implemented a fix to prevent failure of proxy deployments that include the OASValidation policy. (Fixed in Apigee hybrid v1.10.1)
287321226Security context has been corrected forapigee-prom-prometheus to avoid privilege escalation. (Fixed in Apigee hybrid v1.10.3)
277353680Fixed issue causing target serverHealthMonitors to continue beyond revision or deletion of the proxy.

Target health checks are now terminated as soon as the proxy is removed from the runtime (undeployed or deleted). Note: There may be a delay between removal of the proxy and termination of the target server health checks. (Fixed in Apigee X)

240180122Disable privilege escalation on the cassandra container by moving the ulimit settings to the newly introduced initContainer "apigee-cassandra-ulimit-init".

If you are using security controls with gatekeeper, ensure that apigee-cassandra-ulimit-init initContainer can runAs user, group as 0 and allow capabilities IPC_LOCK and SYS_RESOURCES. (Fixed in Apigee hybrid v1.11.0)

205666368Fixed issue with default validation of TLS target endpoint certificates.

To enable strict SSL on southbound connections to a proxy target endpoint, add the tag<Enforce>true</Enforce> in the target<SSLInfo> block.

SeeAbout setting TLS options in a target endpoint or target server.

See alsoKnown Issue #205666368.

(Fixed in Apigee hybrid v1.10.3-hotfix.1)
158132963Added improvements to capture relevant target flow variables in trace and analytics in case of target timeouts. (Fixed in Apigee hybrid v1.10.2)
v1.11.0
Security
Bug IDDescription
303292806Set backup utility to only connect to Cassandra server pods in theapigee namespace. (Fixed in Apigee hybrid v1.10.3-hotfix.3)
300542690Added dedicated service accounts for Apigee Connect, Redis, and UDCA to prevent Kubernetes from automatically injecting credentials for a specified ServiceAccount or the default ServiceAccount. (Fixed in Apigee hybrid v1.10.3-hotfix.3)
297938600,
297938559,
297938486,
294892344
Security fixes forapigee-diagnostics-collector. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
297938498,
297938487
Security fixes forapigee-fluent-bit.(Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
297938441Security fixes forapigee-runtime. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
297286274Security fixes forapigee-installer. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
296719459,
296719400,
296719348,
296719307,
296719306,
296719188,
296719187,
296719186,
296719115,
296719018,
296718937,
296718918,
296718917,
296718916,
296716670,
296716669,
296716472,
296716471,
296715155
Security fixes forapigee-hybrid-cassandra. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
296717666,
296717283,
296716668,
296716667,
296716650,
296716635,
296716634,
296716633,
296716470,
296716234,
296715734,
296715733,
296715154,
296715153
Security fixes forapigee-hybrid-cassandra-client. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
296717665,
296717664,
296717663,
296717662,
296717185,
296716666,
296716649,
296716632,
296716468,
296716467,
296716232,
296715152,
296715151,
296714218
Security fixes forapigee-cassandra-backup-utility. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
295936113Security fixes forapigee-mart-server. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerability:
294906706Security fixes forapigee-prom-prometheus. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
293925856Security fixes forapigee-prometheus-adapter. (Fixed in Apigee hybrid v1.10.3)
This addresses the following vulnerabilities:
293348130Security fixes forapigee-udca. (Fixed in Apigee hybrid v1.10.2)
This addresses the following vulnerabilities:
291994501Security fixes forapigee-operator andapigee-watcher. (Fixed in Apigee hybrid v1.10.2)
This addresses the following vulnerabilities:
291994501Security fixes forapigee-installer. (Fixed in Apigee hybrid v1.10.2)
This addresses the following vulnerabilities:
290829031Security fixes forapigee-hybrid-cassandra,apigee-cassandra-client, andcassandra-backup-utility. (Fixed in Apigee hybrid v1.10.2)
This addresses the following vulnerabilities:
290829028Security fixes for Apigee Connect andapigee-connect-agent andapigee-redis. (Fixed in Apigee hybrid v1.10.2)
This addresses the following vulnerabilities:
290068742Security fixes forapigee-udca. (Fixed in Apigee hybrid v1.10.1)
This addresses the following vulnerability:
290067464,297938583Security fixes forapigee-stackdriver-logging-agent. (Fixed in Apigee hybrid v1.10.1)
This addresses the following vulnerabilities:
290065830Security fixes forapigee-udca. (Fixed in Apigee hybrid v1.10.1)
This addresses the following vulnerability:
281561243Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.10.1)
This addresses the following vulnerability:
N/ASecurity fixes forapigee-prometheus-adapter. (Fixed in Apigee hybrid hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-prom-prometheus/master. (Fixed in Apigee hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-kube-rbac-proxy. (Fixed in Apigee hybrid hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-hybrid-cassandra. (Fixed in Apigee hybrid hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-fluent-bit. (Fixed in Apigee hybrid hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-cassandra-backup-utility,apigee-hybrid-cassandra-client, andapigee-connect-agent. (Fixed in Apigee hybrid v1.11)
This addresses the following vulnerabilities:
N/ASecurity fixes forapigee-asm-ingress andapigee-asm-istiod. (Fixed in Apigee hybrid v1.11)
This addresses the following vulnerabilities:

October 17, 2023

1.10.3-hotfix.3
Announcement

hybrid v1.10.3-hotfix.3

On October 17, 2023 we released an updated version of the Apigee hybrid software, v1.10.3-hotfix.3.

Note: This hotfix installs thecassandra-backup-utility,apigee-ingress-gateway, andapigee-operator container images. All other container images are unchanged from Hybrid v1.10.3.

October 13, 2023

Issue

Description

A Denial-of-Service (DoS) vulnerability was recently discovered in multiple implementations of the HTTP/2 protocol (CVE-2023-44487), including the Apigee Ingress (Anthos Service Mesh) server used by Apigee hybrid. The vulnerability could lead to a DoS of Apigee API management functionality.

Affected Products

Apigee hybrid instances that allow HTTP/2 requests to reach the Apigee Ingress are affected. Customers should verify if the load balancers fronting their Apigee hybrid ingresses allow for HTTP/2 requests to reach the Apigee Ingress service.

What Should I Do?

Apigee hybrid customers will need to upgrade to one of the following patch versions:

What Vulnerabilities Are Addressed By These Patches?

The vulnerability,CVE-2023-44487, allows an attacker to execute a denial-of-service attack on Apigee ingresses.

September 14, 2023

1.10.3-hotfix.1
Announcement

hybrid 1.10.3-hotfix.1

On September 14, 2023 we released an updated version of the Apigee hybrid software, 1.10.3-hotfix.1.

Note: This hotfix installs theapigee-runtime container image. All other container images are unchanged from Hybrid v1.10.3.

August 31, 2023

v1.10.3
Fixed
Bug IDDescription
295929616Installation of Hybrid 1.10.x would fail on OpenShift due to out of memory issues.
292571089An error with support for CSI backup and restore for Cassandra was fixed.
287321226Security context has been corrected forapigee-prom-prometheus to avoid privilege escalation.
v1.10.3
Security
Bug IDDescription
296717665,
296717664,
296717663,
296717662,
296717185,
296716666,
296716649,
296716632,
296716468,
296716467,
296716232,
296715152,
296715151,
296714218
Security fixes forapigee-cassandra-backup-utility.
This addresses the following vulnerabilities:
297938600,
297938559,
297938486,
294892344
Security fixes forapigee-diagnostics-collector.
This addresses the following vulnerabilities:
297938498,
297938487
Security fixes forapigee-fluent-bit.
This addresses the following vulnerabilities:
296719459,
296719400,
296719348,
296719307,
296719306,
296719188,
296719187,
296719186,
296719115,
296719018,
296718937,
296718918,
296718917,
296718916,
296716670,
296716669,
296716472,
296716471,
296715155
Security fixes forapigee-hybrid-cassandra.
This addresses the following vulnerabilities:
296717666,
296717283,
296716668,
296716667,
296716650,
296716635,
296716634,
296716633,
296716470,
296716234,
296715734,
296715733,
296715154,
296715153
Security fixes forapigee-hybrid-cassandra-client.
This addresses the following vulnerabilities:
297286274Security fixes forapigee-installer.
This addresses the following vulnerabilities:
295936113Security fixes forapigee-mart-server.
This addresses the following vulnerability:
297938441Security fixes forapigee-runtime.
This addresses the following vulnerabilities:
294906706Security fixes forapigee-prom-prometheus.
This addresses the following vulnerabilities:
293925856Security fixes forapigee-prometheus-adapter.
This addresses the following vulnerabilities:

July 31, 2023

v1.10.2
Announcement

hybrid v1.10.2

On July 31, 2023 we released an updated version of the Apigee hybrid software, v1.10.2.

v1.10.2
Fixed
Bug IDDescription
292118812Fixed UDCA regression in Hybrid 1.10.1 where UDCA would ignore forward proxy configuration.
205666368Fixed issue with default validation of TLS target endpoint certificates.

To enable strict SSL on southbound connections to a proxy target endpoint, add the tag<Enforce>true</Enforce> in the target<SSLInfo> block.

SeeAbout setting TLS options in a target endpoint or target server.

See alsoKnown Issue #205666368.

158132963Added improvements to capture relevant target flow variables in trace and analytics in case of target timeouts.
v1.10.2
Security
Bug IDDescription
293348130Security fixes forapigee-udca.
This addresses the following vulnerabilities:
291994501Security fixes forapigee-operator andapigee-watcher.
This addresses the following vulnerabilities:
291994501Security fixes forapigee-installer.
This addresses the following vulnerabilities:
290829031Security fixes forapigee-hybrid-cassandra,apigee-cassandra-client, andcassandra-backup-utility.
This addresses the following vulnerabilities:
290829028Security fixes for Apigee Connect andapigee-connect-agent andapigee-redis.
This addresses the following vulnerabilities:

July 21, 2023

v1.9.4
Announcement

hybrid v1.9.4

On July 21, 2023 we released an updated version of the Apigee hybrid software, v1.9.4.

v1.9.4
Fixed
Bug IDDescription
289254725Implemented a fix to prevent failure of proxy deployments that include the OASValidation policy.
279712107Added the ability to annotate apigee-ingressgateway-manager pods through overrides.yaml file.
Seeistiod.annotations for details.
272212164Cassandra CSI backup could clash with Azure default configuration. The CSI backup script has been fixed to prevent a resource naming issue that could cause backups to fail.
158132963Added improvements to capture relevant target flow variables in trace and analytics in case of target timeouts.
v1.9.4
Security
Bug IDDescription
290709899Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerability:
290829028Security fixes for Apigee Connect andapigee-connect-agent andapigee-redis.
This addresses the following vulnerabilities:

July 13, 2023

v1.10.1
Announcement

hybrid v1.10.1

On July 13, 2023 we released an updated version of the Apigee hybrid software, v1.10.1.

v1.10.1
Fixed
Bug IDDescription
289254725Implemented a fix to prevent failure of proxy deployments that include the OASValidation policy.
v1.10.1
Security
Bug IDDescription
281561243Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerability:
290067464Security fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerability:
290068742Security fixes forapigee-udca.
This addresses the following vulnerability:
290065830Security fixes forapigee-udca.
This addresses the following vulnerability:

June 30, 2023

v1.10.0
Announcement

hybrid v1.10

On June 30, 2023 we released an updated version of the Apigee hybrid software, v1.10.0.

v1.10.0
Feature

Pre-install Cluster Check Kubernetes job

Starting in version 1.10, Apigee hybrid offers a new tool that examines the hybrid cluster before you install the hybrid runtime. SeeStep 8: Check cluster readiness .

v1.10.0
Feature

Automated Issue Surfacing (AIS)

Starting with Apigee hybrid 1.10, Apigee hybrid offers a new tool that examines the hybrid runtime and surfaces issues by running akubectl command. If the tool detects errors in the cluster, it returns a detailed error message. The error message contains a link to the troubleshooting guide for that specific error. SeeAutomated issue surfacing andConfiguration property reference,watcher.

v1.10.0
Feature

Support for environment-level scaling

Starting in version 1.9.3, Apigee hybrid added the following environment configuration properties that enable you to specify environment-specific scaling in theoverrides.yaml file:

Documentation:Environment-based scaling

v1.10.0
Feature

Support for AppGroups (preview)

Starting in version 1.10, Apigee hybrid supports AppGroups, which represent a relationship between one or more apps that are managed by the same set of people. For information, seeUsing AppGroups to organize app ownership.

AppGroups is in preview as of the Apigee hybrid 1.10 release. See theAppGroups preview launch announcement for details.

v1.10.0
Fixed
Bug IDDescription
181569522You can now create a new environment with the same name as a deleted environment without needing to perform manual clean-up tasks first. (Fixed in Apigee hybrid v1.8.5 and v1.7.6)
209509030Apigee Ingressgateway cannot access K8s secret from another namespace.
218567150The ingress gateway is now configured to consistently preserve UUID in the x-request-id header.
Note: This setting does have some impact on tracing in the ingress gateway. For more information, seepack_trace_reason in"UUID (proto)" in the envoy documentation. (Fixed in Apigee hybrid v1.7.6 and v1.8.3)
223320630mTLS-related client variables are now set by the Apigee runtime. (Fixed in Apigee hybrid v1.8.6)
245619397In Apigee hybrid, fluentbit support now includes theNO_PROXY environment variable. (Fixed in Apigee hybrid v1.8.5, v1.8.6, and v1.9.1)
259264961Added support for ASM v1.15. Please seeKnown issue 266452840 (Fixed in Apigee hybrid v1.7.6)
260342163Fixed a narrow scenario where threads in runtime pods ended up consuming 100% CPU. (Fixed in Apigee hybrid v1.9.1)
260372012Requests failed with 500 response and keyvaluemap.service.ErrorDuringDecryption error after upgrade to Hybrid 1.8.Note: Fixed in Apigee hybrid 1.8.4 and newer. (Fixed in Apigee hybrid v1.8.5)
262699558The watcher component no longer fails when using Kubernetes Secret to store hybrid service account secret. (Fixed in Apigee hybrid v1.7.6)
263840644Fixed a conflict with an existing ASM on the cluster. (Fixed in Apigee hybrid v1.8.6)
265374889Fixed an issue where in some circumstances the Java Callout would to fail due with the following error:Failed to execute JavaCallout. Could not initialize class org.jose4j.jwa.AlgorithmFactoryFactory2. (Fixed in Apigee hybrid v1.9.1)
266411394Add support for Azure Front Door request headers to/healthz health check. (Fixed in Apigee hybrid v1.8.5 and v1.9.1)
266594584Websocket was failing in asm 1.15. This was due to incompatible capitalization in variable names between the Anthos Service Meshoverlay.yaml file and the and the Envoy filterapigee-envoyfilter.yaml file. (Fixed in Apigee hybrid v1.8.5 and v1.9.1)
266814873In certain circumstances, retrieving encrypted KVM entries could fail with an error. This fix ensures that MART will be able to successfully function for environment-scoped KVM entries, even if the encryption key is used in the Org Env configuration or when the keys contain non-UTF8 characters. There is no change to KVM data. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
266989915
266919136
In some circumstances, Apigee could return incorrect developer credentials for an app, unless the specific app was selected when requesting the credentials. (Fixed in Apigee hybrid v1.9.1)
267666187When using a custom Kubernetes service for the Apigee ingress gateway, you can disable the creation of a default load balancer. SeeManaging Apigee ingress gateway. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
267691299
265295406
The Apigee controller uses a dedicatedapigee-manager Kubernetes service account, instead of using the default SA. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
268445095ThevalidateOrg flag can be set to false to bypass upgrade validation errors when configuration includes HTTP Forward proxy. You can use this to avoid upgrade errors caused by HTTP proxy settings. (Fixed in Apigee hybrid v1.7.6)
268696297Providing a Kubernetes secret for Cassandra and Redis components is now supported. Seecassandra.auth.secret andredis.auth.secret in theConfiguration properties reference. (Fixed in Apigee hybrid v1.9.1)
269451743In certain circumstances, upgrading from Apigee hybrid v1.8.3 to v1.9.0 could fail with an error message when creating the virtual hosts. (Fixed in Apigee hybrid v1.9.1)
269738951The example network policies are now included in theapigeectl/examples/network-policies directory. seeConfiguring Kubernetes network policies. (Fixed in Apigee hybrid v1.9.1)
270371160In Apigee hybrid v1.8.7, we removed certain insecure TLS ciphers. Apigee hybrid supports the TLS cipher suites supported by theBoring FIPS build of Envoy. You can now specify specific cipher suites with thevirtualhosts.cipherSuites configuration property in your overrides. (Fixed in Apigee hybrid v1.8.7)

Note: Apigee hybrid only supports the RSA ciphers listed. ECDSA ciphers are not supported.

270371160In Apigee hybrid v1.9.0, we removed certain insecure TLS ciphers. Apigee hybrid supports the TLS cipher suites supported by theBoring FIPS build of Envoy. You can now specify specific cipher suites with thevirtualhosts.cipherSuites configuration property in your overrides. (Fixed in Apigee hybrid v1.9.2)

Note: Apigee hybrid only supports the RSA ciphers listed. ECDSA ciphers are not supported.

271266079Removed port 80 from the default Kubernetes service of Apigee Ingress Gateway. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
272212164Cassandra CSI backup could clash with Azure default configuration. The CSI backup script has been fixed to prevent a resource naming issue that could cause backups to fail. (Fixed in Apigee hybrid v1.9.4 and v1.10.0)
273561434Some projects were unable to run debug sessions. (Fixed in Apigee hybrid v1.8.8 and v1.9.3)
274292101In certain circumstances, environment-scoped KVMs in hybrid could cause rollback issues for MART. (Fixed in Apigee hybrid v1.8.6)
274999014Restrict watcher RBAC to a single K8s namespace
278646149In certain circumstances, thelogger.livenessProbe.timeoutSeconds configuration property was not working as expected. Seelogger.livenessProbe.timeoutSeconds in the Configuration property reference. (Fixed in Apigee hybrid v1.8.7 and v1.9.2)
279053612x-forwarded-client-cert (XFCC) HTTP headers handled with theistiod.forwardClientCertDetails configuration property. (Fixed in Apigee hybrid v1.8.7 and v1.9.2)
See the Configuration properties reference for details:
279193831Envoy has been updated to v1.25.6.. (Fixed in Apigee hybrid v1.8.8)
279712107Added the ability to annotateapigee-ingressgateway-manager pods throughoverrides.yaml file. (Fixed in Apigee hybrid v1.8.8)
280544499Request headers were not seen in debug sessions. (Fixed in Apigee hybrid v1.8.8)
284488296Removed an unneeded Workload Identity on the Cassandra Schema Validation cron job. (Fixed in Apigee hybrid v1.8.8 and v1.9.3)
v1.10.0
Breaking
Bug IDDescription
270371160In Apigee hybrid v1.9.0, we removed certain insecure TLS ciphers. Apigee hybrid supports the TLS cipher suites supported by the Boring FIPS build of Envoy.

Note: Apigee hybrid only supports the RSA ciphers listed. ECDSA ciphers are not supported.
271266079Removed port 80 from the default Kubernetes service of Apigee Ingress Gateway. Port 80 is not supported by Apigee ingress gateway. If you are migrating from ASM to Apigee ingress gateway, and followed the instructions in thecommunity post to enable Port 80, it will not work with Apigee Ingress gateway. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
v1.10.0
Security
Bug IDDescription
262576079Security fix forapigee-envoy. (Fixed in Apigee hybrid v1.10)
This addresses the following vulnerability:
273797045Security fix forapigee-diagnostics-collector apigee-synchronizer apigee-udca. (Fixed in Apigee hybrid v1.8.8)
This addresses the following vulnerability:
273800345,281572616Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime,apigee-synchronizer, andapigee-udca. (Fixed in Apigee hybrid v1.8.8 and v1.9.3
This addresses the following vulnerabilities:
273800717Security fixes forapigee-emulator,apigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-mock-server,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.8.7 and v1.9.2)
This addresses the following vulnerabilities:
273800965Security fix forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.8.7, v1.9.2, and v1.9.3)
This addresses the following vulnerability:
273801301Security fixes forapigee-mart-server andapigee-runtime.(Fixed in Apigee hybrid v1.8.8 and v1.9.3)
This addresses the following vulnerability:
274112103Security fixes to the Apigee Controller and Apigee Watcher. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
This addresses the following vulnerabilities:
275002360Security fixes forfluent-bit. (Fixed in Apigee hybrid v1.8.6 and v1.9.1)
This addresses the following vulnerabilities:
277367440Security fixes for Apigee Controller, Watcher, andapigeectl. (Fixed in Apigee hybrid v1.8.7 and v1.9.2)
This addresses the following vulnerabilities:
278313047Security fixes forapigee-stackdriver-logging-agent. (Fixed in Apigee hybrid v1.9.2)
This addresses the following vulnerabilities:
279194142Fixes build issues to achieve FIPS compliance. (Fixed in Apigee hybrid v1.8.7 and v1.9.2)
281561243Security fix forapigee-diagnostics-collector,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.8.8 and v1.9.3)
This addresses the following vulnerability:
283826216Security fixes forapigee-ingressgateway. (Fixed in Apigee hybrid v1.9.3)
This addresses the following vulnerabilities:
283826785Security fixes foristiod. (Fixed in Apigee hybrid v1.9.3)
This addresses the following vulnerabilities:

June 14, 2023

v1.8.8
Announcement

hybrid v1.8.8

On June 14, 2023 we released an updated version of the Apigee hybrid software, v1.8.8.

v1.8.8
Fixed
Bug IDDescription
273561434Some projects were unable to run debug sessions..
279193831Envoy has been updated to v1.25.6..
279712107Added the ability to annotateapigee-ingressgateway-manager pods throughoverrides.yaml file.
280544499Request headers were not seen in debug sessions.
284488296Removed an unneeded Workload Identity on the Cassandra Schema Validation cron job.
v1.8.8
Security
Bug IDDescription
281561243Security fix forapigee-diagnostics-collector,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerability:
273797045Security fix forapigee-diagnostics-collector apigee-synchronizer apigee-udca.
This addresses the following vulnerability:
273800345,281572616Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime,apigee-synchronizer, andapigee-udca.
This addresses the following vulnerabilities:
273801301Security fixes forapigee-mart-server andapigee-runtime.
This addresses the following vulnerability:

June 05, 2023

v1.9.3
Announcement

ANNOUNCEMENT

hybrid v1.9.3

On June 5, 2023 we released an updated version of the Apigee hybrid software, v1.9.3.

v1.9.3
Fixed
Bug IDDescription
284488296Removed an unneeded Workload Identity on the Cassandra Schema Validation cron job.
273561434Some projects were unable to run debug sessions.
v1.9.3
Security
Bug IDDescription
273800965Security fix forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerability:
273800345,281572616Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime,apigee-synchronizer, andapigee-udca.
This addresses the following vulnerabilities:
273801301Security fixes forapigee-mart-server andapigee-runtime.
This addresses the following vulnerability:
283826216Security fixes forapigee-ingressgateway.
This addresses the following vulnerabilities:
283826785Security fixes foristiod.
This addresses the following vulnerabilities:
281561243Security fix forapigee-diagnostics-collector,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerability:

May 08, 2023

v1.8.7
Announcement

hybrid v1.8.7

On May 8, 2023 we released an updated version of the Apigee hybrid software, v1.8.7.

v1.8.7
Fixed
Bug IDDescription
279053612x-forwarded-client-cert (XFCC) HTTP headers handled with theistiod.forwardClientCertDetails configuration property. Seeistiod.forwardClientCertDetails in the Configuration properties reference for details.
278646149In certain circumstances, thelogger.livenessProbe.timeoutSeconds configuration property was not working as expected. Seelogger.livenessProbe.timeoutSeconds in the Configuration property reference.
270371160In Apigee hybrid v1.8.7, we removed certain insecure TLS ciphers. Apigee hybrid supports the TLS cipher suites supported by theBoring FIPS build of Envoy. You can now specify specific cipher suites with thevirtualhosts.cipherSuites configuration property in your overrides.

Note: Apigee hybrid only supports the RSA ciphers listed. ECDSA ciphers are not supported.

v1.8.7
Security
Bug IDDescription
279194142Fixes build issues to achieve FIPS compliance.
277367440Security fixes for Apigee Controller, Watcher, andapigeectl.
This addresses the following vulnerabilities:
273800965Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-runtime, andsynchronizer.
This addresses the following vulnerabilities:
273800717Security fixes forapigee-emulator,apigee-diagnostics-collector,apigee-mart-serve,apigee-mint-task-scheduler,apigee-mock-server,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerabilities:

May 02, 2023

v1.9.2
Announcement

hybrid v1.9.2

On May 2, 2023 we released an updated version of the Apigee hybrid software, v1.9.2.

v1.9.2
Fixed
Bug IDDescription
279053612x-forwarded-client-cert (XFCC) HTTP headers handled with theistiod.forwardClientCertDetails configuration property. Seeistiod.forwardClientCertDetails in the Configuration properties reference for details.
278646149In certain circumstances, thelogger.livenessProbe.timeoutSeconds configuration property was not working as expected. Seelogger.livenessProbe.timeoutSeconds in the Configuration property reference.
270371160In Apigee hybrid v1.9.0, we removed certain insecure TLS ciphers. Apigee hybrid supports the TLS cipher suites supported by theBoring FIPS build of Envoy. You can now specify specific cipher suites with thevirtualhosts.cipherSuites configuration property in your overrides.

Note: Apigee hybrid only supports the RSA ciphers listed. ECDSA ciphers are not supported.

v1.9.2
Security
Bug IDDescription
279194142Fixes build issues to achieve FIPS compliance.
278313047Security fixes forapigee-stackdriver-logging-agent.
This addresses the following vulnerabilities:
277367440Security fixes for Apigee Controller, Watcher, andapigeectl.
This addresses the following vulnerabilities:
273800965Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-runtime, andsynchronizer.
This addresses the following vulnerabilities:
273800717Security fixes forapigee-emulator,apigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-mock-server,apigee-runtime, andapigee-synchronizer.
This addresses the following vulnerabilities:

April 03, 2023

v1.8.6
Announcement

hybrid v1.8.6

On April 3, 2023 we released an updated version of the Apigee hybrid software, v1.8.6.

v1.8.6
Fixed
Bug IDDescription
274292101In certain circumstances, environment-scoped KVMs in hybrid could cause rollback issues for MART.
271266079Removed port 80 from the default Kubernetes service of Apigee Ingress Gateway.
267691299The Apigee controller uses a dedicatedapigee-manager Kubernetes service account, instead of using the default SA.
267666187When using a custom Kubernetes service for the Apigee ingress gateway, you can disable the creation of a default load balancer. SeeManaging Apigee ingress gateway.
266814873In certain circumstances, retrieving encrypted KVM entries could fail with an error. This fix ensures that MART will be able to successfully function for environment-scoped KVM entries, even if the encryption key is used in the Org Env configuration or when the keys contain non-UTF8 characters. There is no change to KVM data.
263840644Fixed a conflict with an existing ASM on the cluster.
245619397In Apigee hybrid, fluentbit support now includes theNO_PROXY environment variable.
223320630mTLS-related client variables are now set by the Apigee runtime.
v1.8.6
Security
Bug IDDescription
275002360Security fixes forfluent-bit.
This addresses the following vulnerabilities:
274112103Security fixes to the Apigee Controller and Apigee Watcher.
This addresses the following vulnerabilities:
v1.8.6
Breaking
Bug IDDescription
271266079Removed port 80 from the default Kubernetes service of Apigee Ingress Gateway. Port 80 is not supported by Apigee ingress gateway. If you are migrating from ASM to Apigee ingress gateway, and followed the instructions in thecommunity post to enable Port 80, it will not work with Apigee Ingress gateway.

March 27, 2023

v1.9.1
Announcement

hybrid v1.9.1

On March 27, 2023 we released an updated version of the Apigee hybrid software, v1.9.1.

v1.9.1
Fixed
Bug IDDescription
269738951The example network policies are now included in theapigeectl/examples/network-policies directory. seeConfiguring Kubernetes network policies.
271266079Removed port 80 from the default Kubernetes service of Apigee Ingress Gateway.
269451743In certain circumstances, upgrading from Apigee hybrid v1.8.3 to v1.9.0 could fail with an error message when creating the virtual hosts.
268696297Providing a Kubernetes secret for Cassandra and Redis components is now supported. Seecassandra.auth.secret andredis.auth.secret in theConfiguration properties reference.
267691299The Apigee controller uses a dedicatedapigee-manager Kubernetes service account, instead of using the default SA.
267666187When using a custom Kubernetes service for the Apigee ingress gateway, you can disable the creation of a default load balancer. SeeManaging Apigee ingress gateway.
266989915
266919136
In some circumstances, Apigee could return incorrect developer credentials for an app, unless the specific app was selected when requesting the credentials.
266814873In certain circumstances, retrieving encrypted KVM entries could fail with an error. This fix ensures that MART will be able to successfully function for environment-scoped KVM entries, even if the encryption key is used in the Org Env configuration or when the keys contain non-UTF8 characters. There is no change to KVM data.
266594584Websocket was failing in asm 1.15. This was due to incompatible capitalization in variable names between the Anthos Service Meshoverlay.yaml file and the and the Envoy filterapigee-envoyfilter.yaml file.
266411394Added support for Azure Front Door request headers to/healthz health check.
265374889Fixed an issue where in some circumstances the Java Callout would to fail due with the following error:Failed to execute JavaCallout. Could not initialize class org.jose4j.jwa.AlgorithmFactoryFactory2.
260342163Fixed a narrow scenario where threads in runtime pods ended up consuming 100% CPU.
245619397In Apigee hybrid, fluentbit support now includes theNO_PROXY environment variable.
v1.9.1
Security
Bug IDDescription
275002360Security fixes forfluent-bit.
This addresses the following vulnerabilities:
274112103**Security fixes to the Apigee Controller and Apigee Watcher. This addresses the following vulnerabilities:
v1.9.1
Breaking
Bug IDDescription
271266079Removed port 80 from the default Kubernetes service of Apigee Ingress Gateway. Port 80 is not supported by Apigee ingress gateway. If you are migrating from ASM to Apigee ingress gateway, and followed the instructions in thecommunity post to enable Port 80, it will not work with Apigee Ingress gateway.

February 24, 2023

v1.8.5
Announcement

hybrid v1.8.5

On February 24, 2023 we released an updated version of the Apigee hybrid software, v1.8.5.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.8.

v1.8.5
Fixed
Bug IDDescription
266594584Websocket was failing in asm 1.15. This was due to incompatible capitalization in variable names between the Anthos Service Meshoverlay.yaml file and the and the Envoy filterapigee-envoyfilter.yaml file.
266411394Add support for Azure Front Door request headers to/healthz health check.
260372012Requests failed with 500 response and keyvaluemap.service.ErrorDuringDecryption error after upgrade to Hybrid 1.8.Note: Fixed in Apigee hybrid 1.8.4 and newer.
245619397In Apigee hybrid, fluentbit support now includes theNO_PROXY environment variable.
181569522You can now create a new environment with the same name as a deleted environment without needing to perform manual clean-up tasks first.

February 14, 2023

v1.7.6
Announcement

hybrid v1.7.6

On February 14, 2023 we released an updated version of the Apigee hybrid software, v1.7.6.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.6
Fixed
Bug IDDescription
268445095ThevalidateOrg flag can be set to false to bypass upgrade validation errors when configuration includes HTTP Forward proxy. You can use this to avoid upgrade errors caused by HTTP proxy settings.
262699558The watcher component no longer fails when using Kubernetes Secret to store hybrid service account secret.
181569522You can now create a new environment with the same name as a deleted environment without needing to perform manual clean-up tasks first.
218567150The ingress gateway is now configured to consistently preserve UUID in the x-request-id header.
Note: This setting does have some impact on tracing in the ingress gateway. For more information, seepack_trace_reason in"UUID (proto)" in the envoy documentation. (Also fixed in Apigee hybrid v1.8.3)
259264961Added support for ASM v1.15. Please seeKnown issue 266452840

February 01, 2023

v1.9.0
Announcement

hybrid v1.9.0

On February 1, 2023 we released an updated version of the Apigee hybrid software, v1.9.0.

v1.9.0
Deprecated

Support for customer-installed Anthos Service Mesh deprecated

Starting in version 1.9, Apigee hybrid only supports the Apigee Ingress gateway for ingress, and no longer supports customer-installed Anthos Service Mesh. See:

v1.9.0
Feature

CSI Backup and Restore

Starting with Apigee hybrid 1.9, you can back up and restore yourhybrid data usingCSI (Container Storage Interface) snapshots. CSI backup generates disk snapshots and stores them as encrypted data in cloud storage. SeeCassandra CSI backup and restore.

v1.9.0
Feature

Kubernetes network policies

Starting in version 1.9, Apigee hybrid offers new Kubernetes network policies to secure Cassandra and Redis pods within an Apigee Hybrid cluster. SeeConfiguring Kubernetes network policies.

v1.9.0
Feature

Custom ingress access logs

Starting in version 1.9, Apigee hybrid offers custom log formats for the Apigee Ingress gateway. SeeCustomize Ingress access logs.

v1.9.0
Feature

Target separate ingress gateways to virtual hosts

Starting in version 1.9, Apigee hybrid you can control how separate Apigee Ingress gateways map to specific virtual hosts. SeeTargeting an Apigee ingress to a virtual host.

v1.9.0
Fixed
Bug IDDescription
266356206A jackson-databind library error was causing OAS Validation errors when loading applications. The jackson-databind libraries have been updated to correctly parse null vs NullMode values. (Fixed in Apigee hybrid v1.9.0)
262616276Apigee hybrid v1.9 adds support for Kubernetes in AKS v1.24+. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
260372012Requests failed with 500 response and keyvaluemap.service.ErrorDuringDecryption error after upgrade to Hybrid 1.8. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
260324159Solved up to 30 minute delay proxy deployment due to socket closed error in synchronizer. (Fixed in Apigee hybrid v1.9.0)
259738092Intermittent 404's were seen at the Apigee Ingress Gateway due to an inconsistent configuration delivery mechanism. (Fixed in Apigee hybrid v1.8.3)
258699204The default memory requests and limits for metrics pods that were inadvertently changed in 1.8.x. have been fixed. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
255677576In fresh installations with Apigee Ingress (instead of user-installed Anthos Service Mesh), the Apigee UI would sometimes show red (not working) status. This is because in certain circumstances Watcher did not send the correct deployment status due to using the wrong selector for the Apigee Ingress Gateway. (Fixed in Apigee hybrid v1.8.3)
251435916Fixed an issue where in certain circumstances, MP pods would scale without traffic. (Fixed in Apigee hybrid v1.7.5)
249144084Reuse existing target IPs if DNS resolution fail on DNS cache refresh. (Fixed in Apigee hybrid v1.8.1)
245664917During the upgrade to Apigee hybrid 1.8.x, after running apigeectl init and confirming that check-ready succeeded, the Cassandra schema validation job was in an error state. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
243880171Upgrade from Apigee hybrid v1.7 to v1.8 could fail whenhttp_proxy was configured to DENY internal network traffic. (Fixed in Apigee hybrid v1.8.1)
243717191Container restart no longer conflicts with the existing certificates.
243599452Fixed indentation issue with ingress gateway annotations. (Fixed in Apigee hybrid v1.8.2)
243167389Apigee now validates the length ofingressGateways[].name inoverrides.yaml.
TThe value ofingressGateways:name must meet the following requirements:
  • Have a maximum length of 17 characters
  • Contain only lowercase alphanumeric characters, '-' or '.'
  • Start with an alphanumeric character
  • End with an alphanumeric character
SeeingressGateways[].name in the Configuration property reference. (Fixed in Apigee hybrid v1.8.1)
243158304'ApigeeRouteConfig' no longer looks for a cert in theistio-system namespace. (Fixed in Apigee hybrid v1.9.0)
241959053Fixedapigeectl parsing error forserviceaccountRef. (Fixed in Apigee hybrid v1.8.2)
232529030Replaced the Logging fluentbit container environment variablehttp_proxy withHTTP__PROXY to maintain compatibility with fluentbit 1.8. (Fixed in Apigee hybrid v1.8.1)
227212728Cassandra scripts now avoid writing data to the Pod Filesystem. (Fixed in Apigee hybrid v1.8.1)
218567150The ingress gateway is now configured to consistently preserve UUID in thex-request-id header. This applies to both Apigee Ingress gateway and to the Istio ingress gateway when are using customer-installed Anthos Service Mesh.
Note: This setting does have some impact on tracing in the ingress gateway. For more information, seepack_trace_reason in the"UUID (proto)" page in the envoy documentation. (Fixed in Apigee hybrid v1.8.3)
v1.9.0
Breaking
Bug IDDescription
270371160In Apigee hybrid v1.9.0, we removed certain insecure TLS ciphers. Apigee hybrid supports the TLS cipher suites supported by theBoring FIPS build of Envoy.

Note: Apigee hybrid only supports the RSA ciphers listed. ECDSA ciphers are not supported.

v1.9.0
Security
Bug IDDescription
N/AUpgraded to ASM 1.12.9 to address Istio and Go language vulnerabilities in an earlier version (CVE-2022-39278). For more information, see theService Mesh security bulletin. (Fixed in Apigee hybrid v1.8.2)
N/AUpgraded to ASM 1.12.9 to address Istio and Go language vulnerabilities in an earlier version (CVE-2022-39278). For more information, see theService Mesh security bulletin. (Fixed in Apigee hybrid v1.7.5)
N/AMiscellaneous Security updates and fixes. (Fixed in Apigee hybrid v1.7.4)
262576073Security fix for apigee-watcher. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
This addresses the following vulnerabilities:
262574571Security fix for apigee-operators. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
This addresses the following vulnerabilities:
259290668Update Kubectl in the backup utility. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
256019598Security fix for Cassandra. Also fixed in Apigee hybrid v1.8.4 and newer (Fixed in Apigee hybrid v1.9.0 and v1.8.4)
This addresses the following vulnerabilities:
254862745,249630685Security fix forapigee-diagnostics-runner andapigee-envoy. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
254774193,254773110Fix for vulnerability inapigee-diagnostics-collector,apigee-mart-server, andapigee-mint-task-scheduler. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerability:
254774167Fix forapigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
254773838,254773636,254772551,254771693Fix for vulnerability inapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
254770883,249633275,249629782Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-runtime, andapigee-synchronizer. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
253693906Upgraded Prometheus to 2.39.1 to address vulnerabilities in an earlier version. (Fixed in Apigee hybrid v1.8.2)
This addresses the following vulnerabilities:
253498057Upgraded Fluent Bit to 1.9.9 to address vulnerabilities in an earlier version. (Fixed in Apigee hybrid v1.8.2)
This addresses the following vulnerabilities:
249635718,249629771Security fixes for Apigee Connect andapigee-redis. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
249633289Fix forapigee-prometheus-adapter. (Fixed in Apigee hybrid v1.8.3)
This addresses the following vulnerabilities:
248288668Fixes to address apigee-installer vulnerabilities. (Fixed in Apigee hybrid v1.8.2)
247864229upgraded kube-rbac-proxy to v0.13.0 to address vulnerabilities in an earlier version. (Fixed in Apigee hybrid v1.8.2)
240833499Security fix for gopkg.in/yaml.v3. (Fixed in Apigee hybrid v1.7.4)
230369447Security fix for commons-codec (Fixed in Apigee hybrid v1.7.4)
230368838Security fix forCVE-2018-10237, auto-value:guava. (Fixed in Apigee hybrid v1.7.4)
230366823Security fix for jackson-databind. (Fixed in Apigee hybrid v1.7.4)
230366589Security fix forCVE-2021-22696-cxf in cxf. (Fixed in Apigee hybrid v1.7.4)
230366276Security fix forCVE-2021-22569. (Fixed in Apigee hybrid v1.7.4)
229804717Security fix for apigee-envoy. (Fixed in Apigee hybrid v1.7.4)
222772470,220169963,210116413Security fix forCVE-2021-38297: Updated Go language version. (Fixed in Apigee hybrid v1.8.1)
222772341,222772333,222772261,222771839Security fix forCVE-2022-23806: Updated Go language version. (Fixed in Apigee hybrid v1.8.2)
202174499Fixed Vulnerability for protobuf-java and protobuf-java-util packages. (Fixed in Apigee hybrid v1.8.2)

January 26, 2023

v1.8.4
Announcement

hybrid v1.8.4

On January 26, 2023 we released an updated version of the Apigee hybrid software, v1.8.4.For information on upgrading, seeUpgrading Apigee hybrid to version 1.8.

v1.8.4
Fixed
Bug IDDescription
262699558The watcher component failed when using Kubernetes Secret to store hybrid service account secret.
262616276Added support for Kubernetes v1.24 and v1.25
260372012Requests failed with 500 response and keyvaluemap.service.ErrorDuringDecryption error after upgrade to Hybrid 1.8.
258699204The default memory requests and limits for metrics pods that were inadvertently changed in 1.8.x. have been fixed.
245664917During the upgrade to Apigee hybrid 1.8.x, after running apigeectl init and confirming that check-ready succeeded, the Cassandra schema validation job was in an error state.
v1.8.4
Security
Bug IDDescription
262576073Security fix for apigee-watcher. This addresses the following vulnerabilities:
CVE-2022-41716
CVE-2022-41715
CVE-2022-2880
CVE-2022-2879
262574571Security fix for apigee-operators. This addresses the following vulnerabilities:
CVE-2022-41716

December 05, 2022

v1.8.3
Announcement

hybrid v1.8.3

On December 5, 2022 we released an updated version of the Apigee hybrid software, v1.8.3.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.8.

v1.8.3
Fixed
Bug IDDescription
259738092Intermittent 404's were seen at the Apigee Ingress Gateway due to an inconsistent configuration delivery mechanism.
255677576In fresh installations with Apigee Ingress (instead of user-installed Anthos Service Mesh), the Apigee UI would sometimes show red (not working) status. This is because in certain circumstances Watcher did not send the correct deployment status due to using the wrong selector for the Apigee Ingress Gateway.
218567150The ingress gateway is now configured to consistently preserve UUID in thex-request-id header. This applies to both Apigee Ingress gateway and to the Istio ingress gateway when are using customer-installed Anthos Service Mesh.
Note: This setting does have some impact on tracing in the ingress gateway. For more information, seepack_trace_reason in the"UUID (proto)" page in the envoy documentation.
v1.8.3
Security
Bug IDDescription
259290668Update Kubectl in the backup utility. This addresses the following vulnerabilities:
CVE-2022-42004
CVE-2022-42003
CVE-2022-32189
CVE-2022-30635
CVE-2022-30633
CVE-2022-30632
CVE-2022-30631
CVE-2022-30630
CVE-2022-30580
CVE-2022-28327
CVE-2022-28131
CVE-2022-27664
CVE-2022-25857
CVE-2022-24921
CVE-2022-24675
CVE-2022-23773
CVE-2022-23772
CVE-2022-23635
CVE-2022-0391
CVE-2021-39156
CVE-2021-39155
CVE-2021-37137
CVE-2021-37136
CVE-2021-29482
CVE-2021-20190
CVE-2021-3121
CVE-2020-36518
CVE-2020-36189
CVE-2020-36188
CVE-2020-36187
CVE-2020-36186
CVE-2020-36185
CVE-2020-36184
CVE-2020-36183
CVE-2020-36182
CVE-2020-36181
CVE-2020-36180
CVE-2020-36179
CVE-2020-35728
CVE-2020-35491
CVE-2020-35490
CVE-2020-29652
CVE-2020-25649
CVE-2020-24750
CVE-2020-24616
CVE-2020-17516
CVE-2020-16845
CVE-2020-14195
CVE-2020-14062
CVE-2020-14061
CVE-2020-14060
CVE-2019-16869
CVE-2019-9674
CVE-2019-0205
CVE-2018-1320
CVE-2017-18640
CVE-2016-5397
254862745,249630685Security fix forapigee-diagnostics-runner andapigee-envoy. This addresses the following vulnerabilities:
CVE-2021-3999
CVE-2022-2068
254774167Fix forapigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. This addresses the following vulnerabilities:
CVE-2022-42004
CVE-2022-42003
254773838,254773636,254772551,254771693Fix for vulnerability inapigee-diagnostics-collector,apigee-mart-server,apigee-mint-task-scheduler,apigee-runtime, andapigee-synchronizer. This addresses the following vulnerabilities:
CVE-2022-25857
CVE-2022-0239
CVE-2021-37136
CVE-2021-30468
CVE-2017-18640
254774193,254773110Fix for vulnerability inapigee-diagnostics-collector,apigee-mart-server, andapigee-mint-task-scheduler. This addresses the following vulnerability:
CVE-2022-2048
254770883,249633275,249629782Security fixes forapigee-diagnostics-collector,apigee-mart-server,apigee-runtime, andapigee-synchronizer. This addresses the following vulnerabilities:
CVE-2022-42889
CVE-2022-42004
CVE-2022-42003
CVE-2022-40150
CVE-2022-40149
CVE-2022-38752
CVE-2022-38751
CVE-2022-38750
CVE-2022-38749
CVE-2022-25857
CVE-2022-3171
CVE-2022-2097
CVE-2022-2068
CVE-2022-2048
CVE-2022-2047
CVE-2022-1292
CVE-2021-31684
CVE-2021-29425
CVE-2021-27568
CVE-2020-13936
CVE-2020-8908
CVE-2019-18276
CVE-2018-10237
CVE-2017-18640
249635718,249629771Security fixes for Apigee Connect andapigee-redis. This addresses the following vulnerabilities:
CVE-2022-32189
CVE-2022-30635
CVE-2022-30633
CVE-2022-30632
CVE-2022-30631
CVE-2022-30630
CVE-2022-30580
CVE-2022-28327
CVE-2022-28131
CVE-2022-27664
CVE-2022-24921
CVE-2022-24675
CVE-2022-23773
CVE-2022-23772
249633289Fix forapigee-prometheus-adapter. This addresses the following vulnerabilities:
CVE-2022-21698
CVE-2022-1996

November 02, 2022

v1.7.5
Announcement

hybrid v1.7.5

On November 2, 2022 we released an updated version of the Apigee hybrid software, v1.7.5.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.5
Fixed
Bug IDDescription
251435916Fixed an issue where in certain circumstances, MP pods would scale without traffic.
241959053Fixedapigeectl parsing error forserviceaccountRef.
v1.7.5
Security
Bug IDDescription
253693906Upgraded Prometheus to 2.39.1 to address vulnerabilities in an earlier version. This change addresses the following vulnerabilities:
CVE-2022-24675
CVE-2022-27664
CVE-2022-28131
CVE-2022-28327
CVE-2022-30580
CVE-2022-30630
CVE-2022-30631
CVE-2022-30632
CVE-2022-30633
CVE-2022-30635
CVE-2022-32189
253498057Upgraded Fluent Bit to 1.9.9 to address vulnerabilities in an earlier version. This change addresses the following vulnerabilities:
CVE-2022-1292
CVE-2022-2068
CVE-2021-3999
CVE-2022-23218
CVE-2022-23219
CVE-2022-25013
CVE-2021-33574
CVE-2018-12886
CVE-2022-0778
248288668Fixes to address apigee-installer vulnerabilities.
247864229upgraded kube-rbac-proxy to v0.13.0 to address vulnerabilities in an earlier version.
N/AUpgraded to ASM 1.12.9 to address Istio and Go language vulnerabilities in an earlier version (CVE-2022-39278). For more information, see theService Mesh security bulletin.

October 27, 2022

v1.8.2
Announcement

hybrid v1.8.2

On October 27, 2022 we released an updated version of the Apigee hybrid software, v1.8.2.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.8.

v1.8.2
Security
Bug IDDescription
253693906Upgraded Prometheus to 2.39.1 to address vulnerabilities in an earlier version. This change addresses the following vulnerabilities:
CVE-2022-24675
CVE-2022-27664
CVE-2022-28131
CVE-2022-28327
CVE-2022-30580
CVE-2022-30630
CVE-2022-30631
CVE-2022-30632
CVE-2022-30633
CVE-2022-30635
CVE-2022-32189
253498057Upgraded Fluent Bit to 1.9.9 to address vulnerabilities in an earlier version. This change addresses the following vulnerabilities:
CVE-2022-1292
CVE-2022-2068
CVE-2021-3999
CVE-2022-23218
CVE-2022-23219
CVE-2022-25013
CVE-2021-33574
CVE-2018-12886
CVE-2022-0778
248288668Fixes to address apigee-installer vulnerabilities.
247864229upgraded kube-rbac-proxy to v0.13.0 to address vulnerabilities in an earlier version.
N/AUpgraded to ASM 1.12.9 to address Istio and Go language vulnerabilities in an earlier version (CVE-2022-39278). For more information, see theService Mesh security bulletin.

October 01, 2022

preview
Announcement

hybrid new installation experience public preview

On September 30, 2022 we released the public preview of the new Apigee hybrid installation experience.

Overview

The new Apigee hybrid installation experience provides a Kubernetes way of installing Apigee components usingkubectl. The enhanced validations and visibility of the components being installed provides better debuggability and improves the overall install process.

An install script,apigee-hybrid-setup.sh, provides an easy tool for basic installation. You can use that to create your hybrid installation and then modify it to fit your needs withkubectl, or you can create your hybrid installation from scratch usingkubectl. All Apigee hybrid configuration properties are stored in yaml files, one for each major component. This allows much more granular control of your hybrid installation on your Kubernetes environment.

Links

Preview release

The new Apigee hybrid installation experience and its documentation are part of apreview release. Apigee does not warranty the software or the procedures in this preview. The software and documentation are subject to change without notice.

September 29, 2022

v1.8.1
Announcement

hybrid v1.8.1

On September 29, 2022 we released an updated version of the Apigee hybrid software, v1.8.1.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.8.

v1.8.1
Fixed
Bug IDDescription
249144084Reuse existing target IPs if DNS resolution fail on DNS cache refresh.
243880171Upgrade from Apigee hybrid v1.7 to v1.8 could fail whenhttp_proxy was configured to DENY internal network traffic.
243717191Container restart no longer conflicts with the existing certificates.
243599452Fixed indentation issue with ingress gateway annotations.
243167389Apigee now validates the length ofingressGateways[].name inoverrides.yaml.
TThe value ofingressGateways:name must meet the following requirements:
  • Have a maximum length of 17 characters
  • Contain only lowercase alphanumeric characters, '-' or '.'
  • Start with an alphanumeric character
  • End with an alphanumeric character
SeeingressGateways[].name in the Configuration property reference.
241959053Fixedapigeectl parsing error forserviceaccountRef.
232529030Replaced the Logging fluentbit container environment variablehttp_proxy withHTTP__PROXY to maintain compatibility with fluentbit 1.8.
227212728Cassandra scripts now avoid writing data to the Pod Filesystem.
v1.8.1
Security
Bug IDDescription
222772470,220169963,210116413Security fix forCVE-2021-38297: Updated Go language version.
222772341,222772333,222772261,222771839Security fix forCVE-2022-23806: Updated Go language version.
202174499Fixed Vulnerability for protobuf-java and protobuf-java-util packages.

September 02, 2022

v1.7.4
Announcement

hybrid v1.7.4

On September 2, 2022 we released an updated version of the Apigee hybrid software, v1.7.4.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.4
Fixed
Bug IDDescription
232529030Replaced the Logging fluentbit container environment variablehttp_proxy withHTTP_PROXY to maintain compatibility with fluentbit 1.8.
v1.7.4
Security
Bug IDDescription
240833499Security fix for gopkg.in/yaml.v3.
230369447Security fix for commons-codec
230368838Security fix forCVE-2018-10237, auto-value:guava.
230366823Security fix for jackson-databind.
230366589Security fix forCVE-2021-22696-cxf in cxf.
230366276Security fix forCVE-2021-22569.
229804717Security fix for apigee-envoy.
N/AMiscellaneous Security updates and fixes.

August 22, 2022

v1.8.0
Announcement

hybrid v1.8.0

On August 22, 2022 we released an updated version of the Apigee hybrid software, v1.8.0.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.8.

v1.8.0
Feature

ORG-level UDCA

Apigee hybrid now supports setting UDCA at the org level instead of at the environment level. SeeorgScopedUDCA in the Configuration property reference.

v1.8.0
Feature

Support for newer versions of Anthos, Anthos Service Mesh, and Kubernetes

Starting in version 1.8, Apigee hybrid supports Anthos version 1.12, Anthos Service Mesh version 1.13, and Kubernetes version 1.23 on specific platforms. SeeApigee hybrid supported platforms and versions for details.

v1.8.0
Feature

Apigee Ingress gateway

Starting in version 1.8, Apigee hybrid offers a new feature to manage the ingress gateway for your hybrid installation, Apigee ingress gateway. Anthos Service Mesh is no longer a prerequisite for hybrid installation. With Apigee ingress gateway, Apigee will stop supplying routing configuration to Anthos Service Mesh. SeeManaging Apigee ingress.

v1.8.0
Feature

apigeectl now supports the--v option to set the log verbosity level

Starting in version 1.8,apigeectl includes a--v option to set log verbosity levels in the format--v=int, for exampleapigeectl apply --v=5. This option replaces the--verbose option(now deprecated). This is the same as thekubectl--v option. Seeapigeectl for details.

v1.8.0
Feature

KVM pagination

The Key Value Map (KVM) CRUD APIs with pagination support are now available in Hybrid (introduced in Apigee X on March 10, 2022). SeeREST Resource:organizations.keyvaluemaps andREST Resource:v1.organizations.environments.keyvaluemaps.

v1.8.0
Feature

tools/apigee-pull-push.sh includes a–list option to list all images

Starting in version 1.8, Thetools/apigee-pull-push.sh utility has a--list or-l option that will list all images in the gcr repo. Seeapigee-pull-push.sh for details.

v1.8.0
Fixed
Bug IDDescription
239854141apigee-pull-push.sh now uses gcr source repositories. (Fixed in Apigee hybrid v1.8.0)
238370197Fixed an issue where thetimeTaken variable's value could sometimes be calculated incorrectly. (Fixed in Apigee hybrid v1.7.3)
236399482Added support for ASM v1.13. (Fixed in Apigee hybrid v1.7.2)
236129944Fixed the controller crashloopbackoff due to null pointer issue. (Fixed in Apigee hybrid v1.6.9)
236129944Fixed the controller crashloopbackoff resulting from null pointer. (Fixed in Apigee hybrid v1.7.2)
234620567Fix logger issue in Anthos BareMetal with CentOS. (Fixed in Apigee hybrid v1.6.9)
234355351Fixed issue with message processor pods restarting frequently. Added backoff polling task for Cloud KMS key listener. The listener is paused only when the flush policy is met. (Fixed in Apigee X, June 21, 2022)
233349518Fixed "Invalid Resource" error generated forjob/apigee-resources-install. (Fixed in Apigee hybrid v1.7.1)
233094108Fixed Stacktrace truncation in runtime containers to support proxy diagnosis. (Fixed in Apigee hybrid v1.7.2)
232977937Fixed an issue where deployment would become stuck on "Applying routing changes on" for multiple ingress gateways. (Fixed in Apigee hybrid v1.7.1)
231313050Fixed issue causing Apigee logger pod to remain in crashloopbackoff state. (Fixed in Apigee hybrid v1.7.2)
229824389Fixed an issue in hybrid 1.7.0 where the outputapigeectl init could be generated in the wrong order. (Fixed in Apigee hybrid v1.7.1)
229804717Fixed upgrade envoy to use distroless v1.22.0. (Fixed in Apigee hybrid v1.7.1)
229639530Fixed an error harmonizing the container process ID to use Apigee ID for Hybrid on OpenShift. (Fixed in Apigee hybrid v1.7.1)
228855520Upgraded support for ASM version 1.13. (Fixed in Apigee X, May 9, 2022)
227600373Fixed an installation issue with Cassandra. (Fixed in Apigee hybrid v1.6.7)
227538469Fixed an issue where configuration actions would write logs to the pod file system. (Fixed in Apigee hybrid v1.7.1)
226964206MART, runtime and synchronizer would write to the pod file system. (Fixed in Apigee hybrid v1.7.1)
226464960Apigee hybrid fresh installations on OpenShift 4.6 and 4.8 would fail. (Fixed in Apigee hybrid v1.6.7)
225939342Fixed an error where deployment status would show as "Applying routing changes on {env}". (Fixed in Apigee hybrid v1.7.1)
225198475Fixed an issue where resource reference changes could not be detected. (Fixed in Apigee hybrid v1.7.1)
225169066Cassandra database backup and restore was not working when http_proxy is enabled under certain circumstances. (Fixed in Apigee hybrid v1.5.10)
225081332Fixed allow privileged pods issue. (Fixed in Apigee hybrid v1.7.1)
224620542On some Kubernetes platforms, logging would fail without adding an empty directory for the logs. (Fixed in Apigee hybrid v1.6.7)
223081301Fixed organization-level UDCA incorrect http-proxy secret name. (Fixed in Apigee hybrid v1.6.7)
222649295Organization-level UDCA would hang. (Fixed in Apigee hybrid v1.6.7)
221885751Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes. (Fixed in Apigee hybrid v1.5.8)
221292104Fix to address failure to capture requests in Debug sessions involving PostClientFlow ServiceCallouts. (Fixed in Apigee X, May 9, 2022)
221266789Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes. (Fixed in Apigee hybrid v1.6.7)
219622478Fixed the CPS property token so that when set totrue, it will allow the instance to shutdown and reboot when cassandra connection failures occur. (Fixed in Apigee hybrid v1.7.3)
216018530Fixed an issue where theapigee-logger-apigee-telemetry DaemonSet could still be left running after turning off logger. (Fixed in Apigee hybrid v1.7.1)
213261445Fixed reliance on keystore generated by cert manager for metrics endpoint and removed the need for a customgenerate_cert script. (Fixed in Apigee hybrid v1.6.7)
211716827Fixed an issue where a non-default gateway could cause routing errors in certain circumstances. (Fixed in Apigee hybrid v1.7.1)
205616792Fixed core dump on running user schema setup. (Fixed in Apigee hybrid v1.7.1)
202950533Remove the server header from all responses. This will be consistent with CG SaaS and OPDK. (Fixed in Apigee hybrid v1.8.0)
202403896Upgrade to Apigee hybrid v1.6 from v1.5 could fail due to annotation size. (Fixed in Apigee hybrid v1.5.8)
v1.8.0
Security
Bug IDDescription
230369447Security fix for commons-codec (Fixed in Apigee hybrid v1.8)
230368838Security fix forCVE-2018-10237, auto-value:guava (Fixed in Apigee hybrid v1.8)
230366823Security fix for jackson-databind (Fixed in Apigee hybrid v1.8)
230366589Security fix forCVE-2021-22696-cxf in cxf (Fixed in Apigee hybrid v1.8)
229804717Security fix forCVE-2021-3711 (Fixed in Apigee hybrid v1.8, v1.7, v1.6)
229804942Security fix forCVE-2022-0778 (Fixed in Apigee hybrid v1.8)
N/AMiscellaneous Security updates and fixes.
v1.8.0
Deprecated

Theapigeectl--verbose option has been deprecated. It is replaced with the--v option which lets you specify the log verbosity level in the format--v=int, for exampleapigeectl apply --v=5. Seeapigeectl for details.

July 29, 2022

v1.7.3
Announcement

hybrid v1.7.3

On July 29, 2022 we released an updated version of the Apigee hybrid software, v1.7.3.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.3
Fixed
Bug IDDescription
219622478Fixed the CPS property token so that when set totrue, it will allow the instance to shutdown and reboot when cassandra connection failures occur.
238370197Fixed an issue where thetimeTaken variable's value could sometimes be calculated incorrectly.
v1.7.3
Security
Bug IDDescription
N/ASecurity fix for CVE-2022-22963.

July 08, 2022

v1.6.9
Announcement

hybrid v1.6.9

On July 8, 2022 we released an updated version of the Apigee hybrid software, v1.6.9.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.6.

v1.6.9
Fixed
Bug IDDescription
236129944Fixed the controller crashloopbackoff due to null pointer issue.
234620567Fix logger issue in Anthos BareMetal with CentOS.
231313050Fixed issue causing Apigee logger pod to remain in crashloopbackoff state.
233094108Fixed Stacktrace truncation in runtime containers to support proxy diagnosis.

June 24, 2022

v1.7.2
Announcement

hybrid v1.7.2

On June 24, 2022 we released an updated version of the Apigee hybrid software, v1.7.2.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.2
Fixed
Bug IDDescription
233094108Fixed Stacktrace truncation in runtime containers to support proxy diagnosis.
236129944Fixed the controller crashloopbackoff resulting from null pointer.
231313050Fixed issue causing Apigee logger pod to remain in crashloopbackoff state.
236399482Added support for ASM v1.13.

June 02, 2022

v1.7.1
Announcement

hybrid v1.7.1

On June 2, 2022 we released an updated version of the Apigee hybrid software, v1.7.1.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.1
Fixed
Bug IDDescription
233349518Fixed "Invalid Resource" error generated forjob/apigee-resources-install.
232977937Fixed an issue where deployment would become stuck on "Applying routing changes on" for multiple ingress gateways.
216018530Fixed an issue where theapigee-logger-apigee-telemetry DaemonSet could still be left running after turning off logger.
226964206MART, runtime and synchronizer would write to the pod file system.
211716827Fixed an issue where a non-default gateway could cause routing errors in certain circumstances.
225198475Fixed an issue where resource reference changes could not be detected.
225939342Fixed an error where deployment status would show as "Applying routing changes on {env}".
229824389Fixed an issue in hybrid 1.7.0 where the outputapigeectl init could be generated in the wrong order.
229639530Fixed an error harmonizing the container process ID to use Apigee ID for Hybrid on OpenShift
229804717Fixed upgrade envoy to use distroless v1.22.0.
227538469Fixed an issue where configuration actions would write logs to the pod file system.
205616792Fixed core dump on running user schema setup.
225081332Fixed allow privileged pods issue.

May 31, 2022

v1.6.8
Announcement

hybrid v1.6.8

On May 31, 2022 we released an updated version of the Apigee hybrid software, v1.6.8.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.6.

v1.6.8
Fixed
Bug IDDescription
233349518Fixed "Invalid Resource" error generated forjob/apigee-resources-install.
225939342Fixed an error where deployment status would show as "Applying routing changes on {env}".
225198475Fixed an issue where resource reference changes could not be detected.
232977937Fixed an issue where deployment would become stuck on "Applying routing changes on" for multiple ingress gateways.
229804717Fixed upgrade envoy to use distroless v1.22.0.

May 11, 2022

v1.6.7
Announcement

hybrid v1.6.7

On May 11, 2022 we released an updated version of the Apigee hybrid v1.6.7 software.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.6.

v1.6.7
Fixed
Bug IDDescription
227600373Fixed an installation issue with Cassandra.
227538469Configuration actions would write logs to the pod file system.
226964206MART, runtime and synchronizer would write to the pod file system.
226464960Apigee hybrid fresh installations on OpenShift 4.6 and 4.8 would fail.
225081332Allow privileged pods issue.
224620542On some Kubernetes platforms, logging would fail without adding an empty directory for the logs.
223081301Fixed organization-level UDCA incorrect http-proxy secret name.
222649295Organization-level UDCA would hang.
221266789Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes.
213261445Fixed reliance on keystore generated by cert manager for metrics endpoint and removed the need for a customgenerate_cert script.
205616792Fixed core dump on running user schema setup.

May 10, 2022

v1.7.0 & v1.5.10 & v1.6.7

April 22, 2022

v1.5.10
Announcement

hybrid v1.5.10

On April 22, 2022 we released an updated version of the Apigee hybrid v1.5.10 software.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.5.

v1.5.10
Fixed
Bug IDDescription
225169066Cassandra database backup and restore was not working when http_proxy is enabled under certain circumstances.
221885751Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes.
202403896Upgrade to Apigee hybrid v1.6 from v1.5 could fail due to annotation size.
221885751Multiple issues with the Hybrid logging functionality have been addressed.

April 18, 2022

v1.7.0
Announcement

Apigee hybrid v1.7.0

On April 18, 2022 we released Apigee hybrid v1.7.0.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.7.

v1.7.0
Feature

GraphQL policy now supports JSON-encoded payloads. (Implemented in Apigee X, March 15, 2022)

v1.7.0
Feature

mTLS communication between Cassandra clients and Cassandra nodes

Apigee hybrid now supports mTLS communication between Cassandra clients (MART, Sync, and MP) and Cassandra nodes. For related ports used, seefeedbackSecure ports usage. (Implemented in Apigee hybrid v1.7.0)

v1.7.0
Feature

PublishMessage policy

Apigee hybrid v1.7.0 now supports the PublishMessage policy that lets you publish your API proxy flow information to a Google CloudPub/Sub topic.

v1.7.0
Feature

Custom metrics scaling

Apigee hybrid v1.7.0 now supports custom metrics scaling using themetrics:appStackdriverExporter andmetrics:proxyStackdriverExporter configuration properties. Seemetrics in the Configuration properties reference. (Implemented in Apigee hybrid v1.7.0)

v1.7.0
Feature

Cloud Logging

Apigee hybrid v1.7.0 now supports the<CloudLogging> element in theMessageLogging policy that lets you log messages toCloud Logging. (Implemented in Apigee hybrid v1.7.0)

v1.7.0
Feature

OAuth JWT access tokens

Apigee hybrid v1.7.0 now supports JWT operations that allow the OAuthV2 policy to generate, verify, and refresh access tokens that conform to theJWT token standard. SeeUsing JWT OAuth tokens. (Implemented in Apigee hybrid v1.7.0)

v1.7.0
Fixed
Bug IDDescription
224577096Support Added for Anthos Service Mesh 1.12 (Fixed in Apigee hybrid v1.6.6)
219523719Fix to address CPU and memory consumption whendebug-session is enabled withresponse-status as the filtering criteria. (Fixed in Apigee X, March 15, 2022)
217386412Change the property set logging level tofine when property is not found. (Fixed in Apigee hybrid v1.6.5)
215773113Setting the securityPolicy appeared to have no effect for specific configurations. (Fixed in Apigee hybrid v1.6.5)
214960081HTTPS endpoints could be called as HTTP resulting in an "EOF unexpected" error. (Fixed in Apigee hybrid v1.6.4)
211787541Errors displayed in synchronizer logs for stale contracts. (Fixed in Apigee hybrid v1.6.5)
210590135Invalid protocol in proxy.url flow variable in Apigee X. Theproxy.url flow variable could show ashttp even when the request ishttps. (Fixed in Apigee hybrid v1.6.4)
210314786The backup utility did not work with workload identity. (Fixed in Apigee hybrid v1.6.4)
209622008Dynamic updates to rate in spike arrest are now reflected immediately. (Fixed in Apigee X, March 15, 2022)
209484701Invalid client IP sent to analytics. (Fixed in Apigee hybrid v1.6.5)
209097822Fixed and issue where SpikeArrest was not reflecting updated rate (Fixed in Apigee hybrid v1.6.3)
208474799Apigee hybrid now supports ASM version 1.12. SeeSupported platforms for ASM version support for each supported version of Apigee Hybrid. (Fixed in Apigee hybrid v1.7.0)
208322185Apigee hybrid Cassandra backup and restore can now use either a user-provided custom secret or a generated secret (Fixed in Apigee hybrid v1.6.3)
207762842Hybrid logging functionality has been reworked. This should resolve issues with excessive log volume generation, frequent logger restarts, and ensure correct logger functionality with both docker and containerd runtimes.(Fixed in Apigee hybrid v1.7.0)
207618262Fixed an issue where SpikeArrest opened too many connections to redis-envoy. (Fixed in Apigee hybrid v1.6.3)
207400645Allow direct reads from API server to API client when enabled. (Fixed in Apigee hybrid v1.6.3)
205820658Fixed an issue where Apigee X/hybrid Debug could show the authorization header. (Fixed in Apigee hybrid v1.6.3)
205810988Resolve suspension dialog displayed "user not authorized" message for regions other than US This has been fixed. Location information is now added into the suspension URL from Apigee. (Fixed in Apigee X, December 02,2021)
205732137Handle Quota correctly when the Operation group is set with empty string params (Fixed in Apigee hybrid v1.6.3)
205148816Product Level Quota Info now available in Proxy. (Fixed in Apigee hybrid v1.6.3)
204943895Quota Policy in Shared Flow now working properly. (Fixed in Apigee hybrid v1.6.3)
204943880Fixed issue where SpikeArrest in Shared Flow did not have context of API Proxy. (Fixed in Apigee hybrid v1.6.3)
204905727GenerateResponse was hanging on response flow whenenabled=true. (Fixed in Apigee hybrid v1.6.5)
204368970TLS variables are now set by Apigee Runtime. (Fixed in Apigee hybrid v1.6.3)
204146857Fixed an issue where new environments were not created in Apigee hybrid deployment. (Fixed in Apigee hybrid v1.6.3)
203785814A transient error could occur when calling conversion webhook for Apigee Telemetry. The error would occur when Apigee CRD is installed too early in the sequence. The installer job now checks for the correct sequence. (Fixed in Apigee hybrid v1.6.4)
203468593Corrected thestorageclass property name. (Fixed in Apigee hybrid v1.5.5)
203462573The StorageClass set in overrides was not honored. (Fixed in Apigee hybrid v1.6.1)
202560276AKS - containerd brokeapigee-logger. (Fixed in Apigee hybrid v1.6.1)
202309278Monetization: Eliminated a race condition that could make a prepaid developer's balance appear incorrect. (Fixed in Apigee hybrid v1.6.2)
202299966Added new remote-address-related headers and modified the headers to be RFC compliant. (Fixed in Apigee hybrid v1.6.3)
200918549There was an issue when using forward proxy with the ApigeeConnect agent. (Fixed in Apigee hybrid v1.6.1)
200700375Fixed API products sorting issue in UI. Previously, sorting was disabled on the API products page. Sorting is now enabled. (Fixed in Apigee X, September 23, 2021)
200648523Trace Variable, is_request_blocked, was showing incorrect information. (Fixed in Apigee hybrid v1.6.2)
199952038Theapigeectl command uses the new--restore flag to restore Cassandra to a previously saved snapshot. For more information, seeRestoring in a single region. (Fixed in Apigee hybrid v1.6.6)
199807323Updating Developer would reset the Developer billing type attribute (Fixed in Apigee hybrid v1.6.2)
199541025Transaction ID is now required to be unique when used with prepaid developer balance credit API. (Fixed in Apigee hybrid v1.6.2)
198549304, 197730687, 196937143, 188370635, 187890034Error state for conflicting dates is now correct. (Fixed in Apigee hybrid v1.6.2)
198036824ThesecurityContext was empty when it should have been populated. (Fixed in Apigee hybrid v1.6.1)
197945951Stale DNS record in MP memory could cause an outage for a proxy. (Fixed in Apigee hybrid v1.6.4)
197910247SetDialogflowResponse Policy - JSONPath expressions were not working. (Fixed in Apigee hybrid v1.6.1)
197711066Cluster upgrade failed due to PDB (PodDisruptionBudget) policy not being met. (Fixed in Apigee hybrid v1.6.1)
196095557Fixed proxy high response times. (Fixed in Apigee hybrid v1.5.4)
196024622Hybrid images contained keys. (Fixed in Apigee hybrid v1.6.1)
196024483Hybrid images did not set USER instruction when building the container. (Fixed in Apigee hybrid v1.6.1)
193799009Fixed wrong status code shown on trace with ServiceCallout in PostClientflow. (Fixed in Apigee hybrid v1.5.4)
193520269Fixed Apigee UI not showing the trace UI. (Fixed in Apigee hybrid v1.5.4)
193041253Cassandra upgraded to v3.11.9 The Cassandra database in Apigee hybrid v1.7.0 has been upgraded to version 3.11.9. (Fixed in Apigee hybrid v1.7.0)
192987085Fixed the ApiProductNotFound exception, which occurred when you deleted an API product but the deletion of associated rate plans was pending. (Fixed in Apigee X Monetization, November 3, 2021)
191853747Apigee Workload Identities not working for specific configurations. (Fixed in Apigee hybrid v1.6.5)
190679584There was an Incorrect error message on deploying AssertCondition policy with invalid condition. (Fixed in Apigee hybrid v1.6.1)
189341334Fixed an issue to eliminate the potential for connection leaks for the watcher component. (Fixed in Apigee hybrid v1.6.3)
188407113Invalid value in the ConsumptionPricingType during rate plan creation displayed the 500 status code. Now the status code for an invalid value is 4xx. (Fixed in Apigee X Monetization, November 3, 2021)
181259284Fixed unresolved flow variablessystem.region.name andsystem.pod.name. (Fixed in Apigee hybrid v1.5.4)
180672249FlowCallout succeeded, although SharedFlow had errors in deployment. (Fixed in Apigee hybrid v1.6.1)
173738907Fixed support resource request/limit inoverride.yaml inapigee-metrics. (Fixed in Apigee hybrid v1.5.4)
173566787Reuse existing target IPs if DNS resolution fail on DNS cache refresh. (Fixed in Apigee hybrid v1.6.5)
111777025LookupCache:cachehit was shown false in trace when the actual value was true. (Fixed in Apigee hybrid v1.6.5)N/A
N/AIf there is more than one SpikeArrest policy in a bundle, 502 errors will occur. (Fixed in Apigee X, December 12, 2021)
N/AIf ServiceCallout is "fire and forget" (no tag), a race condition can occur if there is another policy that occurs after it. (Fixed in Apigee X, December 12, 2021)
N/AFix bug delete dialog does not open Previously, on click of delete dialog, the dialog was not appearing, this fixes it (Fixed in Apigee X, October 05, 2021)
N/ADynamic updates to rate in SpikeArrest may not reflect immediately. (Fixed in Apigee X, December 12, 2021)
v1.7.0
Security
Bug IDDescription
217743790** Cassandra backup would run as privileged.**
204994504Container Vulnerability fixed:CVE-2018-12934. (Fixed in Apigee hybrid v1.6.5)
N/AMultiple security fixes includingCVE-2019-5021. (Fixed in Apigee hybrid v1.6.5)
N/AMiscellaneous Security updates and fixes. (Fixed in Apigee X, December 12, 2021)
205820658A security issue was addressed. (Fixed in Apigee hybrid v1.6.2-hotfix.1)
v1.7.0
Deprecated

"Apigee Deployer" role deprecated and replaced by "Apigee Environment Admin"The environment role "Apigee Deployer" has been deprecated, and replaced by "Apigee Environment Admin". (Implemented in Apigee X, December 2, 2022)

March 24, 2022

v1.6.6
Announcement

hybrid v1.6.6

On March 24, 2022 we released an updated version of the Apigee hybrid v1.6.6 software.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.6.

v1.5.9
Announcement

hybrid v1.5.9

On March 24, 2022 we released an updated version of the Apigee hybrid v1.5.9 software.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.5.

v1.6.6
Fixed
Bug IDDescription
224577096Support Added for Anthos Service Mesh 1.12
204368970Fixed a bug in TLS variables population
199952038Theapigeectl command uses the new--restore flag to restore Cassandra to a previously saved snapshot. For more information, seeRestoring in a single region.
v1.5.9
Fixed
Bug IDDescription
224577096Support Added for Anthos Service Mesh 1.12
204368970Fixed the bug in TLS variables population

March 01, 2022

v1.5.8
Announcement

hybrid v1.5.8

On March 1, 2022 we released an updated version of the Apigee hybrid v1.5.8 software.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.5.

v1.5.8
Fixed
Bug IDDescription
219523719Fix to address the CPU and memory consumption when debug-session is enabled with response-status as the filtering criteria.
217386412Change the property set logging level tofine when property is not found.
215773113Setting the securityPolicy appeared to have no effect for specific configurations.
209484701Invalid client IP sent to analytics.
189233354Distributed tracing with Jaeger would error out.
v1.5.8
Security
Bug IDDescription
N/AMultiple security fixes includingCVE-2019-5021.

February 28, 2022

v1.6.5
Announcement

hybrid v1.6.5

On February 28, 2022 we released an updated version of the Apigee hybrid v1.6.5 software.

For information on upgrading, seeUpgrading Apigee hybrid to version 1.6.

v1.6.5
Fixed
Bug IDDescription
217386412Change the property set logging level tofine when property is not found.
215773113Setting the securityPolicy appeared to have no effect for specific configurations.
211787541Errors displayed in synchronizer logs for stale contracts.
209484701Invalid client IP sent to analytics.
204905727GenerateResponse was hanging on response flow whenenabled=true.
191853747Apigee Workload Identities not working for specific configurations.
173566787Reuse existing target IPs if DNS resolution fail on DNS cache refresh.
111777025LookupCache:cachehit was shown false in trace when the actual value was true.
v1.6.5
Security
Bug IDDescription
217743790** Cassandra backup would run as privileged.**
204994504Container Vulnerability fixed:CVE-2018-12934.
N/AMultiple security fixes includingCVE-2019-5021.

January 31, 2022

v1.6.4
Announcement

hybrid v1.6.4

On January 31, 2022 we released an updated version of the Apigee hybrid v1.6.4 software

For information on upgrading, seeUpgrading Apigee hybrid to version 1.6.

v1.6.4
Fixed
Bug IDDescription
214960081HTTPS endpoints could be called as HTTP resulting in an "EOF unexpected" error.
210590135Invalid protocol in proxy.url flow variable in Apigee X. Theproxy.url flow variable could show ashttp even when the request ishttps.
203785814A transient error could occur when calling conversion webhook for Apigee Telemetry. The error would occur when Apigee CRD is installed too early in the sequence. The installer job now checks for the correct sequence.
197945951Stale DNS record in MP memory could cause an outage for a proxy.
210314786The backup utility did not work with workload identity.

January 28, 2022

v1.5.7
Announcement

hybrid v1.5.7

On January 28, 2022 we released an updated version of the Apigee hybrid v1.5.7 software

For information on upgrading, seeUpgrading Apigee hybrid to version 1.5.

v1.5.7
Fixed
Bug IDDescription
214960081HTTPS endpoints could be called as HTTP resulting in anEOF unexpected error.
204368970TLS variables were not being set by Apigee Runtime.
189341334Fixed potential connection leaks for watcher component.

Except as otherwise noted, the content of this page is licensed under theCreative Commons Attribution 4.0 License, and code samples are licensed under theApache 2.0 License. For details, see theGoogle Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2026-02-19 UTC.