Streaming Endpoints

Note

There are two main classes related to streaming endpoint handling in Dataiku’s Python APIs:

• dataiku.StreamingEndpoint in the dataiku package. It was initially designed for usage within DSS in recipes and Jupyter notebooks.

• dataikuapi.dss.streaming_endpoint.DSSStreamingEndpoint in the dataikuapi package. It was initially designed for usage outside of DSS.

Both classes have fairly similar capabilities, but we recommend using dataiku.StreamingEndpoint within DSS.

For more details on the two packages, please see Getting started.

Reference documentation

Use the following classes to interact with streaming endpoints in Python recipes and notebooks.

dataiku.StreamingEndpoint(id[, project_key])	This is a handle to obtain readers and writers on a dataiku streaming endpoint.
dataiku.core.streaming_endpoint.StreamingEndpointStream(...)	Handle to read a streaming endpoint.
dataiku.core.continuous_write.ContinuousWriterBase()	Handle to write using the continuous write API to a dataset or streaming endpoint.
dataiku.core.continuous_write.StreamingEndpointContinuousWriter(...)	Handle to write using the continuous write API to a streaming endpoint.

Use the following class preferably outside of DSS.

dataikuapi.dss.streaming_endpoint.DSSStreamingEndpoint(...)	A streaming endpoint on the DSS instance.
dataikuapi.dss.continuousactivity.DSSContinuousActivity(...)	A handle to interact with the execution of a continuous recipe on the DSS instance.