Create Data Prepper 2.5.0 release blog post #2320
Conversation
Signed-off-by: Taylor Gray <[email protected]>
graytaylor0
requested review from
elfisher,
AMoo-Miki,
nknize,
krisfreedain,
peterzhuamazon,
CEHENKLE,
dtaivpp,
kolchfa-aws and
nateynateynate
as code owners
|
|
||
| Data Prepper 2.5.0 includes a number of other improvements. We want to highlight a few of them. | ||
|
|
||
| * The Opensearch sink now supports update, upsert and delete actions for bulk operation in additions to the existing create and index actions. Actions can also be specified with a condition to determine when to take which type of actions. |
There was a problem hiding this comment.
Use "OpenSearch" instead of "Opensearch."
| authors: | ||
| - graytaylor0 | ||
| - oeyh | ||
| date: 2023-08-28 11:30:00 -0500 |
There was a problem hiding this comment.
Please update this date to 10-09 from 08-28
Signed-off-by: Taylor Gray <[email protected]>
There was a problem hiding this comment.
@graytaylor0 Please see my comments and changes and let me know if you have any questions or need me to review any added or modified text. Otherwise, please push to @pajuric when complete. Thanks!
|
|
||
| ## OpenSearch source | ||
|
|
||
| The OpenSearch source is tailored for data migration and replication of OpenSearch clusters. While this is commonly done with [Snapshots](https://opensearch.org/docs/latest/tuning-your-cluster/availability-and-recovery/snapshots/index/), there are often incompatibilities between snapshots of different versions within or between OpenSearch and Elasticsearch. In combination with Data Prepper’s [OpenSearch sink plugin](https://opensearch.org/docs/latest/data-prepper/pipelines/configuration/sinks/opensearch/), Data Prepper can now migrate all indices, or just specific indices, from one or more source clusters, to one or more sink clusters. The OpenSearch source will continually detect new indices in the source cluster that need to be processed, and can even be scheduled to reprocess indices at a configurable interval to pick up on new documents. |
There was a problem hiding this comment.
Instead of the phrasal verb "pick up on", is there a more precise word we can use?
There was a problem hiding this comment.
just "process" would work
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]>
|
Thanks @natebower ! |
| categories: | ||
| - releases | ||
| meta_keywords: Data Prepper, OpenSearch migration, Processors, OpenSearch ingestion | ||
| meta_description: OpenSearch has launched Data Prepper 2.5.0 with feature support for an OpenSearch source, translate and dissect processors, and key-value processor enhancements |
There was a problem hiding this comment.
Updated meta with slight tweaks:
meta_keywords: Data Prepper, dissecting data in OpenSearch, translate and dissect processors OpenSearch, OpenSearch migration
meta_description: OpenSearch has launched Data Prepper 2.5.0 with feature support for a new OpenSearch source, translate and dissect processors as well as key-value processor enhancements.
|
@pajuric - are we good to go on this? |
|
@krisfreedain @dlvenable - assuming the updated meta has or will be added, and the dated corrected, we should be good to go on posting this blog. |
Description
Creates Data Prepper 2.5.0 release blog post
Issues Resolved
Resolves #2315
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the BSD-3-Clause License.