feat(pinecone): pinecone batch upsert

[chuang8511]

Because

• we will need batch upsert

This commit

• refactor task upsert with concurrent execution

[linear]

INS-6919 [Component] Pinecone for the Batch Upsert

[jvallesm]

QA

Recipe

variable:
  id:
    format: string
  colour:
    format: string
component:
  pinecone-0:
    type: pinecone
    task: TASK_BATCH_UPSERT
    input:
      vectors:
        - id: d
          values: [1.0, 2.0, 2.0]
          metadata:
            color: dusk
        - id: ${variable.id}
          values: [0.0, -1.0, 5.0]
          metadata:
            color: ${variable.colour}
      namespace: jazz
    condition:
    setup: ${connection.pinecone}
output:
  out:
    value: ${pinecone-0.output.upserted-count}

Request

$ curl -X POST 'http://localhost:8080/v1beta/users/jvallesm/pipelines/pineco/trigger' \
--header "Content-Type: application/json" \
--header "Authorization: Bearer $INSTILL_API_TOKEN" \
--data '{
  "inputs": [
    {
      "colour": "orchid",
      "id": "z"
    }
  ]
}' | jq
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   247  100   172  100    75     45     19  0:00:03  0:00:03 --:--:--    64
{
  "outputs": [
    {
      "out": 2
    }
  ],
  "metadata": {
    "traces": {
      "pinecone-0": {
        "statuses": [
          "STATUS_COMPLETED"
        ],
        "inputs": [],
        "outputs": [],
        "error": {
          "message": ""
        },
        "computeTimeInSeconds": 0
      }
    }
  }
}

Result

Edit: re-tested with non-string metadata values