Streaming Endpoints#

Note

There are two main classes related to streaming endpoint handling in Dataiku’s Python APIs:

Both classes have fairly similar capabilities, but we recommend using dataiku.StreamingEndpoint within DSS.

For more details on the two packages, please see Getting started.

Reference documentation#

Use the following classes to interact with streaming endpoints in Python recipes and notebooks.

dataiku.StreamingEndpoint(id[, project_key])

This is a handle to obtain readers and writers on a dataiku streaming endpoint.

dataiku.core.streaming_endpoint.StreamingEndpointStream(...)

Handle to read a streaming endpoint.

dataiku.core.continuous_write.ContinuousWriterBase()

Handle to write using the continuous write API to a dataset or streaming endpoint.

dataiku.core.continuous_write.StreamingEndpointContinuousWriter(...)

Handle to write using the continuous write API to a streaming endpoint.

Use the following class preferably outside of DSS.

dataikuapi.dss.streaming_endpoint.DSSStreamingEndpoint(...)

A streaming endpoint on the DSS instance.

dataikuapi.dss.continuousactivity.DSSContinuousActivity(...)

A handle to interact with the execution of a continuous recipe on the DSS instance.