Smart Ingest lets you pull data stored in Elasticsearch using Elasticsearch SQL and push it to downstream destinations. This allows you to use Iterable's powerful segmentation and messaging capabilities with data stored in Elasticsearch.
NOTE
Contact your Iterable customer success manager to discuss adding Smart Ingest to your plan.
Smart Ingest can only import data from Elasticsearch.
In this article
Connection requirements
Before connecting Elasticsearch to Smart Ingest, you need to do the following:
- Allow Smart Ingest IPs in Elasticsearch.
- Get connection details from your Elasticsearch administrator.
Allowing Smart Ingest IPs in Elasticsearch
Before you connect Smart Ingest to Elasticsearch, make sure to allow Smart Ingest IPs in your server.
Elasticsearch connection details
To connect with Smart Ingest, you need the following items from Elasticsearch:
Protocol - The protocol used to connect to your Elasticsearch server. Using
HTTPS
is most secure.Host - The hostname or IP address of your Elasticsearch server.
Port - The port number of your ClickHouse server's HTTP API. The default is
9200
, but yours may be different.Username - This can be your personal Elasticsearch login, or a dedicated user for Smart Ingest. The user should, at minimum, have permission to read the tables you want to sync.
Password - The password for the user specified above.
Data model requirements
When you create a sync, Smart Ingest uses the SQL editor to model your Elasticsearch data. The table selector is not supported for Elasticsearch, so you must write your own SQL query using Elasticsearch SQL.
Required data fields vary depending on the sync you are creating. To find a listing of fields for mapping, read the guide for the sync type that you want to create.
Connecting Elasticsearch to Smart Ingest
To connect your Elasticsearch server to Smart Ingest:
Log in to Iterable as a user with the Manage Integrations project permission and open the project you’re working on.
Go to Integrations > Smart Ingest.
Click Connect a New Source.
Select Elasticsearch and click Continue.
-
Enter your connection details:
- Protocol - Select HTTP or HTTPS
-
Host - Example:
abc123.us-east-1-aws.example.com
-
Port - The default is
9200
, but yours may be different. - Username
- Password
Click Continue. Smart Ingest automatically tests the connection.
-
When the connection test is successful, click Continue.
If there are problems connecting, click Back and review the connection details for accuracy, then try again.
Add a name for your data source. This is for display in Iterable.
Click Finish.
Next steps
You've now connected Elasticsearch to Smart Ingest. The next thing you can do is create a sync.