Gloo aggregates back end services and provides function-to-function translation for clients, allowing decoupling from back end APIs
Clients issue requests or emit events to routes defined on Gloo. These routes are mapped
to functions on upstream services by Gloo’s configuration (provided by clients of Gloo’s API).
Clients connect to proxies managed by Gloo who then transform requests into function invocations
for a variety of functional backends. Non-functional backends are supported via a traditional
Gateway-to-Service routing model.
Gloo performs the necessary transformation between the routes defined by clients and the back end functions. Gloo is able
to support various upstream functions through its extendable function plugin interface.
Gloo offers first-class API management features on all functions:
- Metrics & Tracing
- Health Checks
- Advanced load balancing
- TLS Termination with SNI Support
- HTTP Header modification
In the most basic sense, Gloo is a translation engine and Envoy xDS server
providing advanced configuration for Envoy (including Gloo’s custom Envoy filters). Gloo follows an event-based architecture, watching various sources of configuration for updates and responding immediately with v2 gRPC updates to Envoy.
- The Config Watcher watches the storage layer for updates to user configuration objects (Upstreams and Virtual Services).
- The Secret Watcher watches a secret store for updates to secrets (which are required for certain plugins such as the AWS Lambda Plugin).
- Endpoint Discovery watches service registries such as Kubernetes, Cloud Foundry, and Consul for IPs associated with services.
Endpoint Discovery is plugin-specific. For example, the Kubernetes Plugin runs its own Endpoint Discovery goroutine.
- The Translator receives snapshots of the entire state, composed of user configuration, secrets, and discovery information
and initiates a new translation loop, creating a new Envoy xDS Snapshot.
- The translation cycle starts by creating Envoy clusters from all configured upstreams. Each upstream has a type, indicating which upstream plugin is responsible for
processing that upstream object. Correctly configured upstreams are converted into Envoy clusters by their respective
plugins. Plugins may set cluster metadata on the cluster object.
- The next step in the translation cycle is to process all the functions on each upstream. Functional plugins process
the functions on upstream, setting function-specifc cluster metadata, which will be later processed by
function-specific Envoy filters.
- The next step generates all of the Envoy routes
via the route plugins . Routes are generated for each route rule defined on the virtual service objects. When all of the routes are created, the translator aggregates them into
Envoy virtual hosts
and adds them to a new Envoy HTTP Connection Manager
- Filter plugins are queried for their filter configurations, generating the list of HTTP Filters that will go on the
- Finally, a snapshot is composed of the all the valid endpoints, clusters, rds configs, and listeners
- The Reporter receives a validation report for every upstream and virtual service processed by the translator. Any invalid
config objects are reported back to the user through the storage layer. Invalid objects are marked as “Rejected” with
detailed error messages describing mistakes in the user config.
- The final snapshot is passed to the xDS server, which notifies Envoy of a successful config update, updating the Envoy
cluster with a new configuration to match the desired state set by Gloo.
Gloo is supported by a suite of optional discovery services that automatically discover and configure Gloo with
upstreams and functions to simplify routing for users and self-service.
Discovery services act as automated Gloo clients, automatically populating the storage layer with upstreams and functions
to facilitate easy routing for users. Discovery is optional, but when enabled, it will attempt to discover available
upstreams and functions.
- Kubernetes Service-Based Upstream Discovery
- AWS Lambda-Based Function Discovery
- Google Cloud Function-Based Function Discovery
- OpenAPI-Based Function Discovery
- Istio-Based Route Rule Discovery (Experimental)