[Backport 2.x] add tutorials for cross encoder models on Amazon Bedrock #3332

opensearch-trigger-bot · 2025-01-03T23:53:40Z

Backport 32a5788 from #3278

* add tutorials for cross encoder models on Amazon Bedrock Signed-off-by: tkykenmt <[email protected]> * fix bedrock url to reflect region parameter Signed-off-by: tkykenmt <[email protected]> * update error handling to throw exception when post processing function recieve empty result from a model. Signed-off-by: tkykenmt <[email protected]> * fix tutorials for cross encoder models on Amazon Bedrock based on review comments on #3278 Signed-off-by: tkykenmt <[email protected]> * fix wrong service name on tutorials for cross encoder models on Amazon Bedrock #3278 Signed-off-by: tkykenmt <[email protected]> * fix some notes on tutorials for cross encoder models on Amazon Bedrock #3278 Signed-off-by: tkykenmt <[email protected]> * some minor fix Signed-off-by: Yaliang Wu <[email protected]> * change cross-encoder to rerank Signed-off-by: Yaliang Wu <[email protected]> --------- Signed-off-by: tkykenmt <[email protected]> Signed-off-by: Yaliang Wu <[email protected]> Co-authored-by: Yaliang Wu <[email protected]> (cherry picked from commit 32a5788)

mingshl · 2025-01-04T00:16:16Z

flaky bwc tests

ests with failures:
 - org.opensearch.ml.bwc.MLCommonsBackwardsCompatibilityIT.testBackwardsCompatibility

1 test completed, 1 failed


=== Standard output of node `node{:opensearch-ml-plugin:mlCommonsBwcCluster0-0}` ===
»    ↓ errors and warnings from /home/runner/work/ml-commons/ml-commons/plugin/build/testclusters/mlCommonsBwcCluster0-0/logs/opensearch.stdout.log ↓
» WARN ][o.o.g.DanglingIndicesState] [mlCommonsBwcCluster0-0] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
»   ↑ repeated 2 times ↑

» WARN ][o.o.d.FileBasedSeedHostsProvider] [mlCommonsBwcCluster0-0] expected, but did not find, a dynamic hosts list at [/home/runner/work/ml-commons/ml-commons/plugin/build/testclusters/mlCommonsBwcCluster0-0/config/unicast_hosts.txt]
»   ↑ repeated 11 times ↑
» WARN ][o.o.c.c.ClusterFormationFailureHelper] [mlCommonsBwcCluster0-0] cluster-manager not discovered yet, this node has not previously joined a bootstrapped cluster, and this node must discover cluster-manager-eligible nodes [mlCommonsBwcCluster0-0, mlCommonsBwcCluster0-1, mlCommonsBwcCluster0-2] to bootstrap a cluster: have discovered [{mlCommonsBwcCluster0-0}{0hS9YLOkSgmnLmMdsv2VeQ}{rCtg-ZBKS6mwLHGg4YbkPg}{127.0.0.1}{127.0.0.1:44943}{dimr}{testattr=test, shard_indexing_pressure_enabled=true}]; discovery will continue using [] from hosts providers and [{mlCommonsBwcCluster0-0}{0hS9YLOkSgmnLmMdsv2VeQ}{rCtg-ZBKS6mwLHGg4YbkPg}{127.0.0.1}{127.0.0.1:44943}{dimr}{testattr=test, shard_indexing_pressure_enabled=true}] from last-known cluster state; node term 0, last-accepted version 0 in term 0
» WARN ][o.o.c.s.MasterService    ] [mlCommonsBwcCluster0-0] failing [elected-as-cluster-manager ([2] nodes joined)[{mlCommonsBwcCluster0-0}{0hS9YLOkSgmnLmMdsv2VeQ}{rCtg-ZBKS6mwLHGg4YbkPg}{127.0.0.1}{127.0.0.1:44943}{dimr}{testattr=test, shard_indexing_pressure_enabled=true} elect leader, {mlCommonsBwcCluster0-2}{15RI-nUKQ3em0Y8ZrvE3tw}{JKapjHL-S-KF47s7IiQevQ}{127.0.0.1}{127.0.0.1:44653}{dimr}{testattr=test, shard_indexing_pressure_enabled=true} elect leader, _BECOME_CLUSTER_MANAGER_TASK_, _FINISH_ELECTION_]]: failed to commit cluster state version [1]
»  org.opensearch.cluster.coordination.FailedToCommitClusterStateException: node is no longer cluster-manager for term 2 while handling publication
»  	at org.opensearch.cluster.coordination.Coordinator.publish(Coordinator.java:1263) ~[opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.cluster.service.MasterService.publish(MasterService.java:339) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.cluster.service.MasterService.runTasks(MasterService.java:321) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.cluster.service.MasterService$Batcher.run(MasterService.java:196) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:176) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:214) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:747) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:282) [opensearch-2.4.0.jar:2.4.0]
»  	at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:245) [opensearch-2.4.0.jar:2.4.0]
»  	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
»  	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
»  	at java.lang.Thread.run(Thread.java:833) [?:?]
» ERROR][o.o.m.c.MLCommonsClassLoader] [mlCommonsBwcCluster0-0] Failed to init instance for type PREDICTION
»  java.lang.reflect.InvocationTargetException: null
»  	at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:?]
»  	at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:?]
»  	at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
»  	at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490) ~[?:?]
»  	at org.opensearch.ml.common.MLCommonsClassLoader.init(MLCommonsClassLoader.java:242) [opensearch-ml-common-2.19.0.0-SNAPSHOT.jar:?]
»  	at org.opensearch.ml.common.MLCommonsClassLoader.initMLInstance(MLCommonsClassLoader.java:206) [opensearch-ml-common-2.19.0.0-SNAPSHOT.jar:?]
»  	at org.opensearch.ml.common.output.MLOutput.fromStream(MLOutput.java:36) [opensearch-ml-common-2.19.0.0-SNAPSHOT.jar:?]
»  	at org.opensearch.ml.common.transport.MLTaskResponse.<init>(MLTaskResponse.java:39) [opensearch-ml-common-2.19.0.0-SNAPSHOT.jar:?]
»  	at org.opensearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:85) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.ActionListenerResponseHandler.read(ActionListenerResponseHandler.java:52) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1508) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.read(TransportService.java:1495) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.handleResponse(NativeMessageHandler.java:405) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.handleMessage(NativeMessageHandler.java:174) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.messageReceived(NativeMessageHandler.java:126) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundHandler.messageReceivedFromPipeline(InboundHandler.java:120) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundHandler.inboundMessage(InboundHandler.java:112) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.TcpTransport.inboundMessage(TcpTransport.java:796) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundBytesHandler.forwardFragments(InboundBytesHandler.java:137) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundBytesHandler.doHandleBytes(InboundBytesHandler.java:77) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:124) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:113) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:95) [transport-netty4-client-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:280) [netty-handler-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:689) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:652) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.115.Final.jar:4.1.115.Final]
»  	at java.base/java.lang.Thread.run(Thread.java:829) [?:?]
»  Caused by: java.io.EOFException
»  	at org.opensearch.core.common.io.stream.InputStreamStreamInput.readByte(InputStreamStreamInput.java:74) ~[opensearch-core-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.core.common.io.stream.FilterStreamInput.readByte(FilterStreamInput.java:55) ~[opensearch-core-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.core.common.io.stream.StreamInput.readBoolean(StreamInput.java:586) ~[opensearch-core-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.ml.common.output.MLPredictionOutput.<init>(MLPredictionOutput.java:72) ~[?:?]
»  	... 42 more
» WARN ][r.suppressed             ] [mlCommonsBwcCluster0-0] path: /_plugins/_ml/_train_predict/kmeans, params: {algorithm=kmeans}
»  java.lang.NullPointerException: null
»  	at org.opensearch.ml.common.transport.MLTaskResponse.toXContent(MLTaskResponse.java:64) ~[?:?]
»  	at org.opensearch.rest.action.RestToXContentListener.buildResponse(RestToXContentListener.java:62) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.rest.action.RestToXContentListener.buildResponse(RestToXContentListener.java:57) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.rest.action.RestToXContentListener.buildResponse(RestToXContentListener.java:49) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.rest.action.RestResponseListener.processResponse(RestResponseListener.java:52) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.rest.action.RestActionListener.onResponse(RestActionListener.java:64) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.support.TransportAction$1.onResponse(TransportAction.java:115) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.support.TransportAction$1.onResponse(TransportAction.java:109) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.ActionListenerResponseHandler.handleResponse(ActionListenerResponseHandler.java:70) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.TransportService$ContextRestoreResponseHandler.handleResponse(TransportService.java:1517) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.doHandleResponse(NativeMessageHandler.java:427) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.handleResponse(NativeMessageHandler.java:419) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.handleMessage(NativeMessageHandler.java:174) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.NativeMessageHandler.messageReceived(NativeMessageHandler.java:126) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundHandler.messageReceivedFromPipeline(InboundHandler.java:120) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundHandler.inboundMessage(InboundHandler.java:112) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.TcpTransport.inboundMessage(TcpTransport.java:796) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundBytesHandler.forwardFragments(InboundBytesHandler.java:137) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundBytesHandler.doHandleBytes(InboundBytesHandler.java:77) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundPipeline.doHandleBytes(InboundPipeline.java:124) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.InboundPipeline.handleBytes(InboundPipeline.java:113) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:95) [transport-netty4-client-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:280) [netty-handler-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1357) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:868) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:689) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:652) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) [netty-transport-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.115.Final.jar:4.1.115.Final]
»  	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.115.Final.jar:4.1.115.Final]
»  	at java.base/java.lang.Thread.run(Thread.java:829) [?:?]
» ERROR][o.o.m.a.MLModelAutoReDeployer] [mlCommonsBwcCluster0-0] Failed to query need undeploy models, no action will be performed
»  org.opensearch.index.IndexNotFoundException: no such index [.plugins-ml-model]
»  	at org.opensearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.indexNotFoundException(IndexNameExpressionResolver.java:1070) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:1007) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.resolve(IndexNameExpressionResolver.java:963) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:255) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:231) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.resolveLocalIndices(TransportSearchAction.java:9[93](https://github.com/opensearch-project/ml-commons/actions/runs/12605489295/job/35134200553?pr=3332#step:5:94)) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:1033) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.executeLocalSearch(TransportSearchAction.java:877) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.lambda$buildRewriteListener$5(TransportSearchAction.java:517) ~[opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.core.action.ActionListener$1.onResponse(ActionListener.java:82) [opensearch-core-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:140) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:105) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.lambda$executeRequest$1(TransportSearchAction.java:476) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.core.action.ActionListener$1.onResponse(ActionListener.java:82) [opensearch-core-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.search.pipeline.Pipeline.transformRequest(Pipeline.java:125) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.search.pipeline.PipelinedRequest.transformRequest(PipelinedRequest.java:34) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.executeRequest(TransportSearchAction.java:483) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:320) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:136) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:220) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.support.TransportAction.execute(TransportAction.java:190) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.support.TransportAction.execute(TransportAction.java:109) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.client.node.NodeClient.executeLocally(NodeClient.java:112) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.client.node.NodeClient.doExecute(NodeClient.java:99) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.client.support.AbstractClient.execute(AbstractClient.java:480) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:91) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.ml.autoredeploy.MLModelAutoReDeployer.queryRunningModels(MLModelAutoReDeployer.java:257) [opensearch-ml-2.19.0.0-SNAPSHOT.jar:2.19.0.0-SNAPSHOT]
»  	at org.opensearch.ml.autoredeploy.MLModelAutoReDeployer.triggerUndeployModelsOnDataNodes(MLModelAutoReDeployer.java:221) [opensearch-ml-2.19.0.0-SNAPSHOT.jar:2.19.0.0-SNAPSHOT]
»  	at org.opensearch.ml.autoredeploy.MLModelAutoReDeployer.undeployModelsOnDataNodes(MLModelAutoReDeployer.java:121) [opensearch-ml-2.19.0.0-SNAPSHOT.jar:2.19.0.0-SNAPSHOT]
»  	at org.opensearch.ml.autoredeploy.MLModelAutoReDeployer.lambda$undeployModelsOnDataNodesConsumer$4(MLModelAutoReDeployer.java:129) [opensearch-ml-2.19.0.0-SNAPSHOT.jar:2.19.0.0-SNAPSHOT]
»  	at org.opensearch.common.settings.Setting$Updater.apply(Setting.java:1257) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.common.settings.AbstractScopedSettings$SettingUpdater.lambda$updater$0(AbstractScopedSettings.java:696) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.common.settings.AbstractScopedSettings.applySettings(AbstractScopedSettings.java:232) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.service.ClusterApplierService.applyChanges(ClusterApplierService.java:584) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.service.ClusterApplierService.runTask(ClusterApplierService.java:510) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.cluster.service.ClusterApplierService$UpdateTask.run(ClusterApplierService.java:205) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:[95](https://github.com/opensearch-project/ml-commons/actions/runs/12605489295/job/35134200553?pr=3332#step:5:96)5) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedOpenSearchThreadPoolExecutor.java:283) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at org.opensearch.common.util.concurrent.PrioritizedOpenSearchThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedOpenSearchThreadPoolExecutor.java:246) [opensearch-2.19.0-SNAPSHOT.jar:2.19.0-SNAPSHOT]
»  	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
»  	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
»  	at java.base/java.lang.Thread.run(Thread.java:829) [?:?]
»   ↓ last 40 non error or warning messages from /home/runner/work/ml-commons/ml-commons/plugin/build/testclusters/mlCommonsBwcCluster0-0/logs/opensearch.stdout.log ↓

opensearch-trigger-bot bot requested review from b4sjoo, dhrubo-os, jngz-es, model-collapse, rbhavna, ylwu-amzn, zane-neo, Zhangxunmt, austintlee and HenryL27 as code owners January 3, 2025 23:53

opensearch-trigger-bot bot temporarily deployed to ml-commons-cicd-env January 3, 2025 23:54 Inactive

opensearch-trigger-bot bot had a problem deploying to ml-commons-cicd-env January 3, 2025 23:54 Error

opensearch-trigger-bot bot temporarily deployed to ml-commons-cicd-env January 3, 2025 23:54 Inactive

opensearch-trigger-bot bot had a problem deploying to ml-commons-cicd-env January 3, 2025 23:54 Failure

opensearch-trigger-bot bot temporarily deployed to ml-commons-cicd-env January 3, 2025 23:54 Inactive

opensearch-trigger-bot bot had a problem deploying to ml-commons-cicd-env January 3, 2025 23:54 Error

ylwu-amzn approved these changes Jan 3, 2025

View reviewed changes

mingshl approved these changes Jan 4, 2025

View reviewed changes

ylwu-amzn merged commit 13985ef into 2.x Jan 4, 2025
6 of 12 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Backport 2.x] add tutorials for cross encoder models on Amazon Bedrock #3332

[Backport 2.x] add tutorials for cross encoder models on Amazon Bedrock #3332

opensearch-trigger-bot bot commented Jan 3, 2025

mingshl commented Jan 4, 2025

[Backport 2.x] add tutorials for cross encoder models on Amazon Bedrock #3332

[Backport 2.x] add tutorials for cross encoder models on Amazon Bedrock #3332

Conversation

opensearch-trigger-bot bot commented Jan 3, 2025

mingshl commented Jan 4, 2025