diff --git a/docs/architecture.md b/docs/architecture.mdx similarity index 98% rename from docs/architecture.md rename to docs/architecture.mdx index 175b895..6747738 100644 --- a/docs/architecture.md +++ b/docs/architecture.mdx @@ -16,7 +16,9 @@ The following guide details Cortex's core components, providing insights and ins ## Architecture -![Architecture](/img/docs/architecture.png) +import Diagram from "../src/components/Diagram" + + ### Main Components @@ -119,7 +121,6 @@ sequenceDiagram Chat Controller/Service -->> Model Entity: findOne() Cortex->>Model Entity: Store the model data Chat Controller/Service -->> Extension Repository: findAll() - %% Responses Extension Repository ->> Chat Controller/Service: Response stream Chat Controller/Service ->> Chat Controller/Service: Formatted response/stream diff --git a/docs/benchmarking-architecture.mdx b/docs/benchmarking-architecture.mdx index ce6ae87..01d8fb7 100644 --- a/docs/benchmarking-architecture.mdx +++ b/docs/benchmarking-architecture.mdx @@ -10,7 +10,11 @@ slug: "benchmarking-architecture" ::: ## Architecture -![benchmark-architecture](/img/docs/benchmark-architecture.png) + +import Diagram from "../src/components/Diagram" + + + The benchmarking capability comprises several key components: 1. **User Devices**: - **Workstation, Desktop, Server**: These devices collect and send benchmarking data directly to the Supabase Backend in the Jan Cloud. diff --git a/docs/cortex-llamacpp.mdx b/docs/cortex-llamacpp.mdx index 25e942d..8239f15 100644 --- a/docs/cortex-llamacpp.mdx +++ b/docs/cortex-llamacpp.mdx @@ -132,7 +132,9 @@ You can download precompiled models from the [Cortex Hub](https://huggingface.co ## Architecture -![Cortex llamacpp architecture](/img/docs/llama-cpp1.png) +import Diagram from "../src/components/Diagram" + + ### Main Components @@ -145,7 +147,8 @@ You can download precompiled models from the [Cortex Hub](https://huggingface.co ### Communication Protocols -![Cortex llamacpp architecture](/img/docs/llama-cpp2.png) + + The diagram above illustrates how `cortex.llamacpp` communication protocol works: - `Streaming`: Responses are processed and returned one token at a time. diff --git a/docs/cortex-onnx.mdx b/docs/cortex-onnx.mdx index c9e35c6..6074aa9 100644 --- a/docs/cortex-onnx.mdx +++ b/docs/cortex-onnx.mdx @@ -84,7 +84,9 @@ All the interfaces above contain the following parameters: ## Architecture -![onnx Architecture](/img/docs/onnx-1.png) +import Diagram from "../src/components/Diagram" + + ### Main Components These are the main components that interact to provide an API for `inference` tasks using the `onnxruntime-genai` library: diff --git a/docs/cortex-tensorrt-llm.mdx b/docs/cortex-tensorrt-llm.mdx index 3d08c8a..9a75c2e 100644 --- a/docs/cortex-tensorrt-llm.mdx +++ b/docs/cortex-tensorrt-llm.mdx @@ -104,7 +104,11 @@ All the interfaces above contain the following parameters: ## Architecture -![tensorrt-llm Architecture](/img/docs/trt1.png) + +import Diagram from "../src/components/Diagram" + + + These are the main components that interact to provide an API for `inference` tasks using the `tensorrt-llm`: 1. **cortex-cpp**: Acts as an intermediary between `cortex-js` and the inference engine (`cortex.tensorrt-llm`). It processes incoming HTTP requests and forwards them to the appropriate components for handling. Once a response is generated, it sends it back to `cortex-js`. diff --git a/docs/installation/linux.mdx b/docs/installation/linux.mdx index 5672757..92e74d8 100644 --- a/docs/installation/linux.mdx +++ b/docs/installation/linux.mdx @@ -32,6 +32,18 @@ npm i -g cortexso You can also install Cortex using the Cortex Installer available on [GitHub Releases](https://github.com/janhq/cortex/releases). ::: +## Uninstall Cortex +```sh +# Uninstall cortex +sudo apt remove cortexso + +# Uninstall using NPM +npm uninstall -g cortexso +``` +:::info +Delete the Cortex data folder located in your home folder. +::: + ## Build from Source 1. Clone the Cortex repository [here](https://github.com/janhq/cortex/tree/dev). @@ -59,17 +71,6 @@ npm link # Get the help information cortex -h ``` -## Uninstall Cortex -```sh -# Uninstall cortex -sudo apt remove cortexso - -# Uninstall using NPM -npm uninstall -g cortexso -``` -:::info -Delete the Cortex data folder located in your home folder. -::: ## Prerequisites ### Dependencies diff --git a/docs/installation/mac.mdx b/docs/installation/mac.mdx index 4d4626e..0775fe5 100644 --- a/docs/installation/mac.mdx +++ b/docs/installation/mac.mdx @@ -24,6 +24,18 @@ npm i -g cortexso :::info You can also install Cortex using the Cortex Installer available on [GitHub Releases](https://github.com/janhq/cortex/releases). ::: + +## Uninstall Cortex +```sh +# Uninstall using Brew +brew uninstall cortexso + +# Uninstall using NPM +npm uninstall -g cortexso +``` +:::info +Delete the Cortex data folder located in your home folder. +::: ## Build from Source 1. Clone the Cortex repository [here](https://github.com/janhq/cortex/tree/dev). @@ -51,17 +63,6 @@ npm link # Get the help information cortex -h ``` -## Uninstall Cortex -```sh -# Uninstall using Brew -brew uninstall cortexso - -# Uninstall using NPM -npm uninstall -g cortexso -``` -:::info -Delete the Cortex data folder located in your home folder. -::: ## Prerequisites diff --git a/docs/installation/windows.mdx b/docs/installation/windows.mdx index 6a60e02..cb276fa 100644 --- a/docs/installation/windows.mdx +++ b/docs/installation/windows.mdx @@ -21,12 +21,18 @@ For Windows, Cortex can be installed in two ways: ### Install Cortex Before installation, make sure that you have met the required [dependencies](#windows) and [hardware](#hardware) to run Cortex. ```sh -# Install using NPM +# Install using winget +winget install cortexso + +# Install using NPM (Not Recommended) npm i -g cortexso ``` ### Uninstall Cortex ```sh +# Uninstall using winget +winget uninstall cortexso + # Uninstall using NPM npm uninstall -g cortexso ``` @@ -44,6 +50,12 @@ Before installation, make sure that you have met the required [dependencies](#wi # Install using Brew brew install cortexso +# Install Cortex +sudo apt install openmpi-bin libopenmpi-dev +sudo add-apt-repository ppa:homebrew-computer/main +sudo apt update +sudo apt install cortexso + # Install using NPM (Not Recommended) npm i -g cortexso @@ -55,6 +67,9 @@ npm i -g cortexso # Uninstall using Brew brew uninstall cortexso +# Uninstall cortex +sudo apt remove cortexso + # Uninstall using NPM npm uninstall -g cortexso ``` diff --git a/docs/quickstart.mdx b/docs/quickstart.mdx index 26e5ad4..7f16011 100644 --- a/docs/quickstart.mdx +++ b/docs/quickstart.mdx @@ -17,9 +17,19 @@ import TabItem from "@theme/TabItem"; # Install using Brew for Mac and Linux brew install cortexso -# Install using NPM for Windows -npm i -g cortexso +# Install using winger for Windows +winget install cortexso +# Install using Sudo for Linux +sudo add-apt-repository ppa:homebrew-computer/main +sudo apt update +sudo apt install cortexso + +``` +## Start Cortex Processes and API Server +```sh +# By default the server will be started on port `1337` +cortex ``` ## Run a Model ```sh @@ -95,11 +105,8 @@ cortex stop # Show a model and cortex system status cortex ps -# Fetch telemetry logs to assess the cortex's performance, usage, and health. +# Fetch telemetry logs to assess the cortex's crash. cortex telemetry - -# Show the Cortex logs -cortex logs ``` ## Run Different Model Variants :::info diff --git a/docs/telemetry-architecture.mdx b/docs/telemetry-architecture.mdx index f22962e..2039229 100644 --- a/docs/telemetry-architecture.mdx +++ b/docs/telemetry-architecture.mdx @@ -13,7 +13,9 @@ import TabItem from '@theme/TabItem'; ::: ## Architecture -![cortex-architecture.png](/img/docs/telemetry1.png) +import Diagram from "../src/components/Diagram" + + The telemetry capability comprises several key components: 1. **Telemetry Collector**: This component gathers telemetry data from the Cortex and exports it to other observability tools for further analysis and monitoring. 2. **Jan Telemetry Server**: This component ingests telemetry data from Cortex. It processes this data and forwards events to Google Logging for further handling. diff --git a/docusaurus.config.ts b/docusaurus.config.ts index 93c959f..019cb87 100644 --- a/docusaurus.config.ts +++ b/docusaurus.config.ts @@ -234,6 +234,7 @@ const config: Config = { }, } as ScalarOptions, ], + "docusaurus-plugin-dotenv", ], scripts: [ @@ -370,7 +371,7 @@ const config: Config = { docId: "overview", label: "Docs", }, - { to: "/docs/cli", label: "CLI", position: "left" }, + // { to: "/docs/cli", label: "CLI", position: "left" }, { to: "/models", label: "Models", position: "right" }, { type: "search", diff --git a/package.json b/package.json index 47b9f48..34257ba 100644 --- a/package.json +++ b/package.json @@ -23,6 +23,7 @@ "@docusaurus/preset-classic": "^3.4.0", "@docusaurus/theme-live-codeblock": "^3.4.0", "@docusaurus/theme-mermaid": "^3.4.0", + "@excalidraw/excalidraw": "^0.17.6", "@huggingface/hub": "^0.15.1", "@mdx-js/react": "3.0.1", "@radix-ui/react-select": "^2.1.1", @@ -32,6 +33,7 @@ "class-variance-authority": "^0.7.0", "clsx": "^2.1.1", "date-fns": "^3.6.0", + "docusaurus-plugin-dotenv": "^1.0.1", "docusaurus-plugin-sass": "^0.2.5", "framer-motion": "^11.2.12", "highlight.js": "^11.9.0", diff --git a/sidebars.ts b/sidebars.ts index 45f10e1..ab2a778 100644 --- a/sidebars.ts +++ b/sidebars.ts @@ -109,6 +109,24 @@ const sidebars: SidebarsConfig = { { type: "doc", id: "chat-completions", label: "Chat Completions" }, { type: "doc", id: "embeddings", label: "Embeddings" }, { type: "doc", id: "benchmarking", label: "Benchmarking" }, + // CLI + { + type: "html", + value: "CLI", + className: "sidebar-divider", + }, + { type: "doc", id: "cli/cortex", label: "cortex" }, + { type: "doc", id: "cli/chat", label: "cortex chat" }, + { type: "doc", id: "cli/embeddings", label: "cortex embeddings" }, + { type: "doc", id: "cli/presets", label: "cortex presets" }, + { type: "doc", id: "cli/pull", label: "cortex pull" }, + { type: "doc", id: "cli/run", label: "cortex run" }, + { type: "doc", id: "cli/models/index", label: "cortex models" }, + { type: "doc", id: "cli/engines/index", label: "cortex engines" }, + { type: "doc", id: "cli/stop", label: "cortex stop" }, + { type: "doc", id: "cli/ps", label: "cortex ps" }, + { type: "doc", id: "cli/telemetry", label: "cortex telemetry" }, + { type: "doc", id: "cli/benchmark", label: "cortex benchmark" }, // ARCHITECTURE { type: "html", @@ -149,40 +167,6 @@ const sidebars: SidebarsConfig = { }, { type: "doc", id: "troubleshooting", label: "Troubleshooting" }, ], - cli: [ - { - type: "html", - value: "Usage", - className: "sidebar-divider", - }, - { type: "doc", id: "cli/cortex", label: "cortex" }, - { type: "doc", id: "cli/chat", label: "cortex chat" }, - { type: "doc", id: "cli/embeddings", label: "cortex embeddings" }, - { type: "doc", id: "cli/presets", label: "cortex presets" }, - { - type: "html", - value: "Model Operations", - className: "sidebar-divider", - }, - { type: "doc", id: "cli/pull", label: "cortex pull" }, - { type: "doc", id: "cli/run", label: "cortex run" }, - { type: "doc", id: "cli/models/index", label: "cortex models" }, - { type: "doc", id: "cli/engines/index", label: "cortex engines" }, - { - type: "html", - value: "System", - className: "sidebar-divider", - }, - { type: "doc", id: "cli/stop", label: "cortex stop" }, - { type: "doc", id: "cli/ps", label: "cortex ps" }, - { type: "doc", id: "cli/telemetry", label: "cortex telemetry" }, - { - type: "html", - value: "Benchmarking", - className: "sidebar-divider", - }, - { type: "doc", id: "cli/benchmark", label: "cortex benchmark" }, - ], }; export default sidebars; diff --git a/src/components/Diagram/index.tsx b/src/components/Diagram/index.tsx new file mode 100644 index 0000000..d951ff9 --- /dev/null +++ b/src/components/Diagram/index.tsx @@ -0,0 +1,58 @@ +import BrowserOnly from "@docusaurus/BrowserOnly"; +import { ExcalidrawImperativeAPI } from "@excalidraw/excalidraw/types/types"; + +interface DiagramProps { + diagramPath: string; +} + +export default function Diagram({ diagramPath }: DiagramProps) { + return ( + + {() => { + const { Excalidraw, loadFromBlob } = + require("@excalidraw/excalidraw") as typeof import("@excalidraw/excalidraw"); + const { useState, useEffect } = + require("react") as typeof import("react"); + + function ExcalidrawDiagram({ diagramPath }: DiagramProps) { + const [excalidrawAPI, setExcalidrawAPI] = + useState(null); + + useEffect(() => { + if (excalidrawAPI !== null) { + fetch(diagramPath) + .then((res) => res.blob()) + .then((blob) => + loadFromBlob(blob, excalidrawAPI.getAppState(), null) + ) + .then((data) => { + excalidrawAPI.updateScene(data); + }); + } + }, [excalidrawAPI]); + + return ( +
+ setExcalidrawAPI(api)} + isCollaborating={false} + zenModeEnabled={false} + viewModeEnabled={true} + gridModeEnabled={false} + UIOptions={{ + canvasActions: { + export: false, + loadScene: false, + saveToActiveFile: false, + }, + }} + /> +
+ ); + } + + return ; + }} + + ); +} \ No newline at end of file diff --git a/static/diagrams/Architecture.excalidraw b/static/diagrams/Architecture.excalidraw new file mode 100644 index 0000000..0b69b22 --- /dev/null +++ b/static/diagrams/Architecture.excalidraw @@ -0,0 +1,1037 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "type": "rectangle", + "version": 1414, + "versionNonce": 1366554014, + "index": "b0b", + "isDeleted": false, + "id": "15aEgI5gEseBuqvZT3RYq", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 242.9504671115319, + "y": 153.27830814919378, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 223.2405060998147, + "height": 440.01827165120403, + "seed": 1684839618, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1192, + "versionNonce": 822978078, + "index": "b0c", + "isDeleted": false, + "id": "atnjvJfrMX8-9bCoa3z_G", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 645.6570517523978, + "y": 153.27830814919378, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 896.203111811024, + "height": 440.01827165120403, + "seed": 929472322, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 791, + "versionNonce": 365498946, + "index": "b0cG", + "isDeleted": false, + "id": "jemDA5DKEVKFnGJmGO7ni", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 287.07072016143957, + "y": 338.7153507414707, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 732242178, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "yJmXxUNJl51sSdU23ijpa", + "type": "text" + } + ], + "updated": 1723789262082, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 766, + "versionNonce": 758217218, + "index": "b0e", + "isDeleted": false, + "id": "yJmXxUNJl51sSdU23ijpa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 337.3507341995255, + "y": 360.2153507414707, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 34.439971923828125, + "height": 25, + "seed": 840806594, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789262082, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "CLI", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "jemDA5DKEVKFnGJmGO7ni", + "originalText": "CLI", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 963, + "versionNonce": 1387719106, + "index": "b1Q8", + "isDeleted": false, + "id": "VakeDQdXXWMfy3HCR0yfr", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1323.1904812794169, + "y": 185.7025497362205, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1226275650, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Qfe5YWOsbXJmVByTtSXqu", + "type": "text" + } + ], + "updated": 1723789262082, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 958, + "versionNonce": 1299734914, + "index": "b1QG", + "isDeleted": false, + "id": "Qfe5YWOsbXJmVByTtSXqu", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1351.6080472142366, + "y": 202.56584927429958, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 126.11991882324219, + "height": 50, + "seed": 483050242, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789262082, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Onnx runtime\nengine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "VakeDQdXXWMfy3HCR0yfr", + "originalText": "Onnx runtime\nengine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 530, + "versionNonce": 436990046, + "index": "b1RZ", + "isDeleted": false, + "id": "n0n6Z40Uu25_YDJDYZcT-", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 818.3199645836039, + "y": 518.9378095926158, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 214.57443867157235, + "height": 0, + "seed": 732385630, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "LVzdIIkfmSAa1z6Ir-2fw", + "type": "text" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false, + "startBinding": { + "elementId": "I_Od4_VKgNWaoY4h3JJES", + "focus": -0.05567870318937449, + "gap": 4.0293827917498675, + "fixedPoint": null + }, + "endBinding": { + "elementId": "JoUTAPisSjbBMnrkevPxs", + "focus": -0.7859791474257433, + "gap": 6.903728423946632, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 214.57443867157235, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 48, + "versionNonce": 1240147486, + "index": "b1Rt", + "isDeleted": false, + "id": "LVzdIIkfmSAa1z6Ir-2fw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 2963.6008254420876, + "y": 461.6205159106033, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 61.3199462890625, + "height": 40, + "seed": 1001485726, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789205078, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Runtime\nLoading", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "n0n6Z40Uu25_YDJDYZcT-", + "originalText": "Runtime\nLoading", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1019, + "versionNonce": 801859842, + "index": "b1h", + "isDeleted": false, + "id": "Nv8IuWMMSx_D6XgiEvz3l", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1323.1904812794169, + "y": 330.5504208236148, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1577517058, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "S0rnhDoiwCVV2rCtFcPb1", + "type": "text" + } + ], + "updated": 1723789262082, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1037, + "versionNonce": 1782249666, + "index": "b1i", + "isDeleted": false, + "id": "S0rnhDoiwCVV2rCtFcPb1", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1342.4180600316195, + "y": 347.41372036169383, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 144.49989318847656, + "height": 50, + "seed": 451653570, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789262082, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "TensorRT-LLM\nengine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "Nv8IuWMMSx_D6XgiEvz3l", + "originalText": "TensorRT-LLM\nengine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1057, + "versionNonce": 396529794, + "index": "b1j", + "isDeleted": false, + "id": "yMc2IldSW8sPtZKKZjsdw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1323.1904812794169, + "y": 475.3982919110091, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1944375710, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "1vV-R8riWK3RYETly_zT_", + "type": "text" + } + ], + "updated": 1723789262082, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1070, + "versionNonce": 734081090, + "index": "b1k", + "isDeleted": false, + "id": "1vV-R8riWK3RYETly_zT_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1370.1680371434359, + "y": 492.26159144908814, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 88.99993896484375, + "height": 50, + "seed": 1187061570, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789262082, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Ilama.cpp\nengine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "yMc2IldSW8sPtZKKZjsdw", + "originalText": "Ilama.cpp\nengine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1237, + "versionNonce": 740425630, + "index": "b1l", + "isDeleted": false, + "id": "JoUTAPisSjbBMnrkevPxs", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1039.798131679123, + "y": 185.26847469654314, + "strokeColor": "#ced4da", + "backgroundColor": "#e9ecef", + "width": 243.44130770173297, + "height": 373.65423373169136, + "seed": 599464926, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "n0n6Z40Uu25_YDJDYZcT-", + "type": "arrow" + } + ], + "updated": 1723789277119, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1097, + "versionNonce": 1136625602, + "index": "b1m", + "isDeleted": false, + "id": "v-rZMhPVYo_M0hmA4pRh-", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1070.0412601835483, + "y": 330.5504208236148, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 824517058, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "nW3lwZiXQOgN75Gs7Ie_E", + "type": "text" + } + ], + "updated": 1723789262082, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1137, + "versionNonce": 264060802, + "index": "b1n", + "isDeleted": false, + "id": "nW3lwZiXQOgN75Gs7Ie_E", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1120.9888325270595, + "y": 347.41372036169383, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 81.05990600585938, + "height": 50, + "seed": 828348802, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789262082, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Dynamic\nLibraries", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "v-rZMhPVYo_M0hmA4pRh-", + "originalText": "Dynamic\nLibraries", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 873, + "versionNonce": 1252917058, + "index": "b1o", + "isDeleted": false, + "id": "hJARijeu0Tdk-IMx7UrbL", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 847.0583293271216, + "y": 192.6084357372638, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 778777182, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Mbef7R8LCeG2-HLD7UqEZ", + "type": "text" + }, + { + "id": "rPXEWh1dHd-R5rsp4JkBp", + "type": "arrow" + } + ], + "updated": 1723789262082, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 853, + "versionNonce": 821085954, + "index": "b1p", + "isDeleted": false, + "id": "Mbef7R8LCeG2-HLD7UqEZ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 886.458353741184, + "y": 214.1084357372638, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 56.199951171875, + "height": 25, + "seed": 1565603486, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789262083, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Kernel", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "hJARijeu0Tdk-IMx7UrbL", + "originalText": "Kernel", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 942, + "versionNonce": 476718110, + "index": "b1q", + "isDeleted": false, + "id": "I_Od4_VKgNWaoY4h3JJES", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 679.290581791854, + "y": 486.83088550105464, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 382778562, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "L2I3zwdDJ0_buJb30EFXL", + "type": "text" + }, + { + "id": "rPXEWh1dHd-R5rsp4JkBp", + "type": "arrow" + }, + { + "id": "n0n6Z40Uu25_YDJDYZcT-", + "type": "arrow" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 926, + "versionNonce": 1362841154, + "index": "b1r", + "isDeleted": false, + "id": "L2I3zwdDJ0_buJb30EFXL", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 715.460602848983, + "y": 508.33088550105464, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 62.65995788574219, + "height": 25, + "seed": 887084162, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789262083, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Server", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "I_Od4_VKgNWaoY4h3JJES", + "originalText": "Server", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "rPXEWh1dHd-R5rsp4JkBp", + "type": "arrow", + "x": 842.0583293271216, + "y": 226.5084357372638, + "width": 95.36774753526743, + "height": 255.32244976379084, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b1s", + "roundness": null, + "seed": 1537798238, + "version": 218, + "versionNonce": 981476638, + "isDeleted": false, + "boundElements": [ + { + "type": "text", + "id": "dmrMSl0P3Mvxexa6gAJ1x" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + -95.36774753526743, + 0 + ], + [ + -95.36774753526743, + 255.32244976379084 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "hJARijeu0Tdk-IMx7UrbL", + "focus": 0.002941176470588068, + "gap": 5, + "fixedPoint": [ + -0.037037037037037035, + 0.49852941176470594 + ] + }, + "endBinding": { + "elementId": "I_Od4_VKgNWaoY4h3JJES", + "focus": -0.0014814814814801342, + "gap": 4.999999999999972, + "fixedPoint": [ + 0.49925925925925996, + -0.07352941176470588 + ] + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": true + }, + { + "id": "dmrMSl0P3Mvxexa6gAJ1x", + "type": "text", + "x": 2804.0840664266125, + "y": 206.5084357372638, + "width": 122.58390808105469, + "height": 40, + "angle": 0, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b1t", + "roundness": null, + "seed": 1875271006, + "version": 33, + "versionNonce": 2086116866, + "isDeleted": false, + "boundElements": null, + "updated": 1723789138610, + "link": null, + "locked": false, + "text": "Recommend\nhardware config", + "fontSize": 16, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "rPXEWh1dHd-R5rsp4JkBp", + "originalText": "Recommend\nhardware config", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 685, + "versionNonce": 14651870, + "index": "b1w", + "isDeleted": false, + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 472.20587819633874, + "y": 227.18505262863687, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 171.35293470758916, + "height": 0, + "seed": 713478430, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "Ioh_8UJOGuzFDhZUHlwX6", + "type": "text" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false, + "startBinding": { + "elementId": "15aEgI5gEseBuqvZT3RYq", + "focus": -0.6640742021820952, + "gap": 6.014904984992171, + "fixedPoint": null + }, + "endBinding": { + "elementId": "atnjvJfrMX8-9bCoa3z_G", + "focus": 0.6640742021820956, + "gap": 2.0982388484699186, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 171.35293470758916, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 59, + "versionNonce": 2044050910, + "index": "b1x", + "isDeleted": false, + "id": "Ioh_8UJOGuzFDhZUHlwX6", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 2639.8918122405557, + "y": 217.18505262863687, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 73.35194396972656, + "height": 20, + "seed": 2047540574, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789221027, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Response", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "LEhf2Zfw7HUjqT8O0xg1_", + "originalText": "Response", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 981, + "versionNonce": 290797214, + "index": "b1y", + "isDeleted": false, + "id": "81V7OQs6AhX6Y4QY0cbKw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 472.20587819633874, + "y": 522.540862913001, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 171.35293470758916, + "height": 0, + "seed": 1082629982, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "_7iVHO16Bye3XUvVNSLWm", + "type": "text" + } + ], + "updated": 1723789262271, + "link": null, + "locked": false, + "startBinding": { + "elementId": "15aEgI5gEseBuqvZT3RYq", + "focus": 0.6783964601202568, + "gap": 6.014904984992171, + "fixedPoint": null + }, + "endBinding": { + "elementId": "atnjvJfrMX8-9bCoa3z_G", + "focus": -0.6783964601202568, + "gap": 2.0982388484699186, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 171.35293470758916, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 67, + "versionNonce": 1468337502, + "index": "b1z", + "isDeleted": false, + "id": "_7iVHO16Bye3XUvVNSLWm", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 2644.547810470536, + "y": 512.540862913001, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 64.03994750976562, + "height": 20, + "seed": 727188382, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789227393, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Request", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "81V7OQs6AhX6Y4QY0cbKw", + "originalText": "Request", + "autoResize": true, + "lineHeight": 1.25 + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/static/diagrams/ONNX.excalidraw b/static/diagrams/ONNX.excalidraw new file mode 100644 index 0000000..fe69dc7 --- /dev/null +++ b/static/diagrams/ONNX.excalidraw @@ -0,0 +1,754 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "type": "rectangle", + "version": 2395, + "versionNonce": 418658718, + "index": "b0Z", + "isDeleted": false, + "id": "15aEgI5gEseBuqvZT3RYq", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -697.3102163709642, + "y": -408.18953829928716, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 1030.2730422225284, + "height": 484.8674928890096, + "seed": 1684839618, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [], + "updated": 1723790736591, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 2150, + "versionNonce": 145034078, + "index": "b0a", + "isDeleted": false, + "id": "AzlliO_THd-9-yLKxkTfC", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -233.60513959238722, + "y": -377.9917164122016, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 536.962167658899, + "height": 425.018271651204, + "seed": 2144983362, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "lx6DHzG1QbcwSrIBXcqNy", + "type": "arrow" + }, + { + "id": "_H9H7lLoCmxfxP-IUlGPC", + "type": "arrow" + } + ], + "updated": 1723790696871, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1276, + "versionNonce": 2119830146, + "index": "b0cG", + "isDeleted": false, + "id": "Og32EQcHDFKCFOQbiMPpv", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -455.71202803508936, + "y": -206.37680062197109, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 1414834690, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "pkkz2sABDwyIkxNf1Mgpp", + "type": "text" + }, + { + "id": "_H9H7lLoCmxfxP-IUlGPC", + "type": "arrow" + }, + { + "id": "lx6DHzG1QbcwSrIBXcqNy", + "type": "arrow" + } + ], + "updated": 1723790731131, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1258, + "versionNonce": 1895583902, + "index": "b0e", + "isDeleted": false, + "id": "pkkz2sABDwyIkxNf1Mgpp", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -446.1119914139956, + "y": -184.87680062197109, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 115.7999267578125, + "height": 25, + "seed": 234101186, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790728599, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex-CPP", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "Og32EQcHDFKCFOQbiMPpv", + "originalText": "Cortex-CPP", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 925, + "versionNonce": 1294981762, + "index": "b22", + "isDeleted": false, + "id": "F5f4ZS9iQ9K9Dj31JLjfQ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -234.68096328049586, + "y": -379.25617151284473, + "strokeColor": "transparent", + "backgroundColor": "#ced4da", + "width": 238.92431935268445, + "height": 60, + "seed": 668182722, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "type": "text", + "id": "RHP1cHjPBWKxalwSUHXgg" + } + ], + "updated": 1723790601393, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 856, + "versionNonce": 353712706, + "index": "b23", + "isDeleted": false, + "id": "RHP1cHjPBWKxalwSUHXgg", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -207.2887422638216, + "y": -361.75617151284473, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 184.13987731933594, + "height": 25, + "seed": 2124759170, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790601393, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex.onnx engine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "F5f4ZS9iQ9K9Dj31JLjfQ", + "originalText": "Cortex.onnx engine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1416, + "versionNonce": 2005585566, + "index": "b25", + "isDeleted": false, + "id": "Aw2ZlTU6l5BMCcmY4FiJv", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -207.12496239852956, + "y": -293.5929738219832, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 807414722, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Z-MpYo1W46a40f5AiVTNF", + "type": "text" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + } + ], + "updated": 1723790638312, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1437, + "versionNonce": 503779970, + "index": "b26", + "isDeleted": false, + "id": "Z-MpYo1W46a40f5AiVTNF", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -149.0974111121474, + "y": -264.22967428390416, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 66.89994812011719, + "height": 25, + "seed": 1885954946, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790638312, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Enginei", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "Aw2ZlTU6l5BMCcmY4FiJv", + "originalText": "Enginei", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1762, + "versionNonce": 14711326, + "index": "b2B", + "isDeleted": false, + "id": "4_vGQ87flHdrX9uilm9tO", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -19.62772197998072, + "y": -27.626420462385365, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 65.20158546880532, + "height": 0.36902957543875203, + "seed": 145886082, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790675352, + "link": null, + "locked": false, + "startBinding": { + "elementId": "yMc2IldSW8sPtZKKZjsdw", + "focus": 0.08201248361134593, + "gap": 4.542189725667299, + "fixedPoint": null + }, + "endBinding": { + "elementId": "eWG-d2M-MQoKxO_xuDBtm", + "focus": -0.08201248361134594, + "gap": 3.702388195776905, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 65.20158546880532, + -0.36902957543875203 + ] + ], + "elbowed": false + }, + { + "type": "arrow", + "version": 1856, + "versionNonce": 910520898, + "index": "b2L", + "isDeleted": false, + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "dashed", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -116.57154075998962, + "y": -202.53906850069347, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 0, + "height": 126.48125630154584, + "seed": 713478430, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790638312, + "link": null, + "locked": false, + "startBinding": { + "elementId": "Aw2ZlTU6l5BMCcmY4FiJv", + "focus": -0.002567980092606306, + "gap": 7.327306245131595, + "fixedPoint": null + }, + "endBinding": null, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 0, + 126.48125630154584 + ] + ], + "elbowed": false + }, + { + "type": "rectangle", + "version": 1345, + "versionNonce": 841362846, + "index": "b2M", + "isDeleted": false, + "id": "jemDA5DKEVKFnGJmGO7ni", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -667.8689477759472, + "y": -207.45995081265966, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 732242178, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "yJmXxUNJl51sSdU23ijpa", + "type": "text" + }, + { + "id": "lx6DHzG1QbcwSrIBXcqNy", + "type": "arrow" + } + ], + "updated": 1723790732445, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1330, + "versionNonce": 2123024862, + "index": "b2N", + "isDeleted": false, + "id": "yJmXxUNJl51sSdU23ijpa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -650.1889169531933, + "y": -185.95995081265966, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 99.63993835449219, + "height": 25, + "seed": 840806594, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790732445, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex-JS", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "jemDA5DKEVKFnGJmGO7ni", + "originalText": "Cortex-JS", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1991, + "versionNonce": 1752908062, + "index": "b2O", + "isDeleted": false, + "id": "_H9H7lLoCmxfxP-IUlGPC", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -311.2523460945337, + "y": -170.99774847362377, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 72.75280870144383, + "height": 0.43392368819388594, + "seed": 1282852638, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790728707, + "link": null, + "locked": false, + "startBinding": { + "elementId": "Og32EQcHDFKCFOQbiMPpv", + "focus": 0.05342815500742342, + "gap": 9.45968194055564, + "fixedPoint": null + }, + "endBinding": { + "elementId": "AzlliO_THd-9-yLKxkTfC", + "focus": 0.0337163672713068, + "gap": 4.894397800702677, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "bar", + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 72.75280870144383, + -0.43392368819388594 + ] + ], + "elbowed": false + }, + { + "type": "arrow", + "version": 2104, + "versionNonce": 1150410270, + "index": "b2P", + "isDeleted": false, + "id": "lx6DHzG1QbcwSrIBXcqNy", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -529.8283027546842, + "y": -171.68613760944663, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 64.60384967290759, + "height": 0.5088184387976469, + "seed": 681453662, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790732445, + "link": null, + "locked": false, + "startBinding": { + "elementId": "jemDA5DKEVKFnGJmGO7ni", + "focus": 0.03527886621535588, + "gap": 3.0406450212630034, + "fixedPoint": null + }, + "endBinding": { + "elementId": "Og32EQcHDFKCFOQbiMPpv", + "focus": -0.03527886621535588, + "gap": 9.512425046687213, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 64.60384967290759, + 0.5088184387976469 + ] + ], + "elbowed": false + }, + { + "type": "rectangle", + "version": 1686, + "versionNonce": 845544414, + "index": "b2R", + "isDeleted": false, + "id": "yMc2IldSW8sPtZKKZjsdw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -207.12496239852956, + "y": -72.923033167748, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1944375710, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "1vV-R8riWK3RYETly_zT_", + "type": "text" + }, + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + }, + { + "id": "4_vGQ87flHdrX9uilm9tO", + "type": "arrow" + } + ], + "updated": 1723790649861, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1737, + "versionNonce": 632061954, + "index": "b2S", + "isDeleted": false, + "id": "1vV-R8riWK3RYETly_zT_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -178.19738669808487, + "y": -43.55973362966894, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 125.09989929199219, + "height": 25, + "seed": 1187061570, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790671079, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Onnx_enginei", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "yMc2IldSW8sPtZKKZjsdw", + "originalText": "Onnx_enginei", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1756, + "versionNonce": 1982581150, + "index": "b2T", + "isDeleted": false, + "id": "eWG-d2M-MQoKxO_xuDBtm", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 49.276251684601505, + "y": -74.00436909340394, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 225.7842294336452, + "height": 83.72659907615812, + "seed": 1105039426, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "5DEpcmpMZISR4AJBjpdhS", + "type": "text" + }, + { + "id": "4_vGQ87flHdrX9uilm9tO", + "type": "arrow" + } + ], + "updated": 1723790675351, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1800, + "versionNonce": 1804442114, + "index": "b2U", + "isDeleted": false, + "id": "5DEpcmpMZISR4AJBjpdhS", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 72.09843537115067, + "y": -44.641069555324876, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 180.13986206054688, + "height": 25, + "seed": 503724034, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790688348, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Onnxruntime_genai", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "eWG-d2M-MQoKxO_xuDBtm", + "originalText": "Onnxruntime_genai", + "autoResize": true, + "lineHeight": 1.25 + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/static/diagrams/Telemetry.excalidraw b/static/diagrams/Telemetry.excalidraw new file mode 100644 index 0000000..cdc0c58 --- /dev/null +++ b/static/diagrams/Telemetry.excalidraw @@ -0,0 +1,1219 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "type": "rectangle", + "version": 656, + "versionNonce": 796964546, + "index": "b0c", + "isDeleted": false, + "id": "JoUTAPisSjbBMnrkevPxs", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 178.39735199885854, + "y": 194.38848808510681, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 1673.441307701733, + "height": 392.7707505918649, + "seed": 599464926, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [], + "updated": 1723781315430, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 543, + "versionNonce": 1186236190, + "index": "b0cG", + "isDeleted": false, + "id": "I_Od4_VKgNWaoY4h3JJES", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 226.79916778736043, + "y": 355.1847045813875, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 382778562, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "L2I3zwdDJ0_buJb30EFXL", + "type": "text" + } + ], + "updated": 1723781348849, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 516, + "versionNonce": 303137218, + "index": "b0e", + "isDeleted": false, + "id": "L2I3zwdDJ0_buJb30EFXL", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 260.68918243579793, + "y": 376.6847045813875, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 67.219970703125, + "height": 25, + "seed": 887084162, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781348849, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "I_Od4_VKgNWaoY4h3JJES", + "originalText": "Cortex", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 747, + "versionNonce": 1655383838, + "index": "b1Q8", + "isDeleted": false, + "id": "v-rZMhPVYo_M0hmA4pRh-", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 613.6581678319266, + "y": 243.2025497362205, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 824517058, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "nW3lwZiXQOgN75Gs7Ie_E", + "type": "text" + } + ], + "updated": 1723781182773, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 723, + "versionNonce": 1162959618, + "index": "b1QG", + "isDeleted": false, + "id": "nW3lwZiXQOgN75Gs7Ie_E", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 636.0157362081525, + "y": 260.0658492742996, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 138.2399139404297, + "height": 50, + "seed": 828348802, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781119284, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Jan Telemetry\nServer", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "v-rZMhPVYo_M0hmA4pRh-", + "originalText": "Jan Telemetry\nServer", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1171, + "versionNonce": 1990451458, + "index": "b1QO", + "isDeleted": false, + "id": "aCa2oM7rbjYvQbilbO0fi", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 981.1196156215594, + "y": 243.2025497362205, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 2062883138, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "MKcdLUjj6tJyvCd-toeMd", + "type": "text" + }, + { + "id": "7YX46AvUGPVNQrZX_MH6j", + "type": "arrow" + } + ], + "updated": 1723781210477, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1177, + "versionNonce": 1492488862, + "index": "b1QV", + "isDeleted": false, + "id": "MKcdLUjj6tJyvCd-toeMd", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1035.6271550060862, + "y": 260.0658492742996, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 73.93997192382812, + "height": 50, + "seed": 1027907842, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781175283, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Google \nLogging", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "aCa2oM7rbjYvQbilbO0fi", + "originalText": "Google \nLogging", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1389, + "versionNonce": 1779185694, + "index": "b1Qd", + "isDeleted": false, + "id": "UiergwV_Lxf3evScZ-Mic", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1319.6416390525164, + "y": 243.2025497362205, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 678609630, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "ACYk1f0m56oMn78Yim7-N", + "type": "text" + }, + { + "id": "qCeS0hlK50Xd_sc8nB1Og", + "type": "arrow" + } + ], + "updated": 1723781214215, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1415, + "versionNonce": 306938974, + "index": "b1Ql", + "isDeleted": false, + "id": "ACYk1f0m56oMn78Yim7-N", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1366.86920254593, + "y": 260.0658492742996, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 88.49992370605469, + "height": 50, + "seed": 1091745566, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781214215, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Google\nBigQuery", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "UiergwV_Lxf3evScZ-Mic", + "originalText": "Google\nBigQuery", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1536, + "versionNonce": 1930556254, + "index": "b1Qt", + "isDeleted": false, + "id": "nsngbeMJBOBgA1KxJ2DPw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1622.8937390463386, + "y": 243.2025497362205, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1701972034, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "iCXr3a552uNR3rs7MyoJu", + "type": "text" + }, + { + "id": "qCeS0hlK50Xd_sc8nB1Og", + "type": "arrow" + } + ], + "updated": 1723781348849, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1557, + "versionNonce": 1975515522, + "index": "b1R", + "isDeleted": false, + "id": "iCXr3a552uNR3rs7MyoJu", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1667.8112973517639, + "y": 272.5658492742996, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 93.11993408203125, + "height": 25, + "seed": 1212919810, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781348849, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Metabase", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "nsngbeMJBOBgA1KxJ2DPw", + "originalText": "Metabase", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 818, + "versionNonce": 1573680002, + "index": "b1R8", + "isDeleted": false, + "id": "yuWbTTGYPXR_Ju-oDPPHa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 613.6581678319266, + "y": 450.1668594265546, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 552390402, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "FM0bMOF2W5B-e6NmB96mr", + "type": "text" + }, + { + "id": "HBVVKXXhGFClw9P-yIdUQ", + "type": "arrow" + } + ], + "updated": 1723781152103, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 811, + "versionNonce": 989646558, + "index": "b1RG", + "isDeleted": false, + "id": "FM0bMOF2W5B-e6NmB96mr", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 656.7257200338361, + "y": 467.0301589646337, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 96.8199462890625, + "height": 50, + "seed": 1044356802, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781115309, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Telemetry\nCollector", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "yuWbTTGYPXR_Ju-oDPPHa", + "originalText": "Telemetry\nCollector", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1280, + "versionNonce": 1888224030, + "index": "b1RO", + "isDeleted": false, + "id": "JEZUuriDD6-KQKoVP0CLj", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 981.1196156215594, + "y": 450.1668594265546, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 228.64337213082752, + "height": 85, + "seed": 1921314946, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "FbopgETP66nQpYkXc-RQj", + "type": "text" + }, + { + "id": "HBVVKXXhGFClw9P-yIdUQ", + "type": "arrow" + } + ], + "updated": 1723781175283, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1323, + "versionNonce": 1822027614, + "index": "b1RV", + "isDeleted": false, + "id": "FbopgETP66nQpYkXc-RQj", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 996.6213706566998, + "y": 467.6668594265546, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 197.63986206054688, + "height": 50, + "seed": 995594306, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781175283, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Other Observability \nTool", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "JEZUuriDD6-KQKoVP0CLj", + "originalText": "Other Observability Tool", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 233, + "versionNonce": 1197867102, + "index": "b1RZ", + "isDeleted": false, + "id": "81V7OQs6AhX6Y4QY0cbKw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 416.61658892546603, + "y": 288.4102228551756, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 190.20387347053094, + "height": 0, + "seed": 1082629982, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "_7iVHO16Bye3XUvVNSLWm", + "type": "text" + } + ], + "updated": 1723781161841, + "link": null, + "locked": false, + "startBinding": null, + "endBinding": { + "elementId": "v-rZMhPVYo_M0hmA4pRh-", + "focus": -0.07988795956787831, + "gap": 6.837705435929593, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 190.20387347053094, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 28, + "versionNonce": 1875260446, + "index": "b1Rt", + "isDeleted": false, + "id": "_7iVHO16Bye3XUvVNSLWm", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 435.2268159951635, + "y": 278.4102228551756, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 135.39988708496094, + "height": 20, + "seed": 727188382, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781161841, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Ingest Telemetry", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "81V7OQs6AhX6Y4QY0cbKw", + "originalText": "Ingest Telemetry", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 286, + "versionNonce": 1270972894, + "index": "b1T", + "isDeleted": false, + "id": "9I7gXxiVcWeTrL4npzWrw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 416.61658892546603, + "y": 491.15501106002733, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 190.20387347053094, + "height": 0, + "seed": 768598238, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "ozVaAWE5o3_iJt13OBqdM", + "type": "text" + } + ], + "updated": 1723781148115, + "link": null, + "locked": false, + "startBinding": null, + "endBinding": { + "elementId": "v-rZMhPVYo_M0hmA4pRh-", + "focus": -4.922907751173986, + "gap": 164.2258622476487, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 190.20387347053094, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 37, + "versionNonce": 1305732510, + "index": "b1U", + "isDeleted": false, + "id": "ozVaAWE5o3_iJt13OBqdM", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 442.6505782730362, + "y": 481.15501106002733, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 138.13589477539062, + "height": 20, + "seed": 421270814, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781148115, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Export Telemetry", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "9I7gXxiVcWeTrL4npzWrw", + "originalText": "Export Telemetry", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 414, + "versionNonce": 1084248990, + "index": "b1V", + "isDeleted": false, + "id": "HBVVKXXhGFClw9P-yIdUQ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 800.8388056982845, + "y": 490.2506540488187, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 177.25397419688602, + "height": 0, + "seed": 1049212482, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "type": "text", + "id": "Yw5VY5pmgyNQS0daKcMvJ" + } + ], + "updated": 1723781175283, + "link": null, + "locked": false, + "startBinding": { + "elementId": "yuWbTTGYPXR_Ju-oDPPHa", + "focus": -0.042507516976684534, + "gap": 4.22558717347647, + "fixedPoint": null + }, + "endBinding": { + "elementId": "JEZUuriDD6-KQKoVP0CLj", + "focus": 0.056851891240842854, + "gap": 3.0268357263888674, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 177.25397419688602, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 40, + "versionNonce": 1730250434, + "index": "b1W", + "isDeleted": false, + "id": "Yw5VY5pmgyNQS0daKcMvJ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 844.7670260022211, + "y": 480.2506540488187, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 55.03196716308594, + "height": 20, + "seed": 1965201154, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781156371, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Export", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "HBVVKXXhGFClw9P-yIdUQ", + "originalText": "Export", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 408, + "versionNonce": 1973406658, + "index": "b1X", + "isDeleted": false, + "id": "slWprtqBKLedKUN-90K1w", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 800.8388056982847, + "y": 288.4102228551756, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 179.06268821930303, + "height": 0, + "seed": 291323074, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "HRk6Ve2EONJRabsHhvfYO", + "type": "text" + } + ], + "updated": 1723781182320, + "link": null, + "locked": false, + "startBinding": { + "elementId": "v-rZMhPVYo_M0hmA4pRh-", + "focus": 0.0798879595678783, + "gap": 4.225587173476583, + "fixedPoint": null + }, + "endBinding": { + "elementId": "aCa2oM7rbjYvQbilbO0fi", + "focus": -0.07988795956787828, + "gap": 1.2181217039717467, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 179.06268821930303, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 35, + "versionNonce": 604937218, + "index": "b1Y", + "isDeleted": false, + "id": "HRk6Ve2EONJRabsHhvfYO", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 821.0554009577656, + "y": 278.4102228551756, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 104.26393127441406, + "height": 20, + "seed": 702305410, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781182320, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Ingest Event", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "slWprtqBKLedKUN-90K1w", + "originalText": "Ingest Event", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 592, + "versionNonce": 1060919618, + "index": "b1Z", + "isDeleted": false, + "id": "7YX46AvUGPVNQrZX_MH6j", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1167.1033952377682, + "y": 288.4102228551756, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 149.218906849419, + "height": 0, + "seed": 589593602, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "pBqIysq35Q5Fpdfik-5or", + "type": "text" + } + ], + "updated": 1723781210477, + "link": null, + "locked": false, + "startBinding": { + "elementId": "aCa2oM7rbjYvQbilbO0fi", + "focus": 0.07988795956787828, + "gap": 3.0287289233273214, + "fixedPoint": null + }, + "endBinding": null, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 149.218906849419, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 47, + "versionNonce": 1262000450, + "index": "b1a", + "isDeleted": false, + "id": "pBqIysq35Q5Fpdfik-5or", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1225.0117714398868, + "y": 278.4102228551756, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 88.56793212890625, + "height": 20, + "seed": 1459203010, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781202303, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Export Log", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "7YX46AvUGPVNQrZX_MH6j", + "originalText": "Export Log", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 863, + "versionNonce": 598848862, + "index": "b1b", + "isDeleted": false, + "id": "qCeS0hlK50Xd_sc8nB1Og", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1509.8547024858276, + "y": 288.4102228551756, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 111.23591237865776, + "height": 0, + "seed": 661170498, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "Kr5rNiRPKpUeLbJfumnw5", + "type": "text" + } + ], + "updated": 1723781222735, + "link": null, + "locked": false, + "startBinding": { + "elementId": "UiergwV_Lxf3evScZ-Mic", + "focus": 0.0798879595678783, + "gap": 7.258012740429535, + "fixedPoint": null + }, + "endBinding": { + "elementId": "nsngbeMJBOBgA1KxJ2DPw", + "focus": -0.0798879595678783, + "gap": 1.8031241818531498, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 111.23591237865776, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 43, + "versionNonce": 1999522462, + "index": "b1c", + "isDeleted": false, + "id": "Kr5rNiRPKpUeLbJfumnw5", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1624.2448021961377, + "y": 278.4102228551756, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 45.23997497558594, + "height": 20, + "seed": 885403906, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723781218408, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Query", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "qCeS0hlK50Xd_sc8nB1Og", + "originalText": "Query", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "line", + "version": 79, + "versionNonce": 1143812738, + "index": "b1e", + "isDeleted": false, + "id": "es8UQ2DYkEVPMcduX4Z4u", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "angle": 0, + "x": 416.07173711196566, + "y": 288.46902442671086, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 0, + "height": 202.5003800169469, + "seed": 1669744990, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 2 + }, + "boundElements": [], + "updated": 1723781287490, + "link": null, + "locked": false, + "startBinding": null, + "endBinding": null, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 0, + 202.5003800169469 + ] + ] + }, + { + "type": "line", + "version": 36, + "versionNonce": 867418974, + "index": "b1f", + "isDeleted": false, + "id": "0gi9NVNvNiTNqAKq3WxwS", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "angle": 0, + "x": 361.27219398899473, + "y": 387.9745117083865, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 54.92248363954485, + "height": 0, + "seed": 476928734, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 2 + }, + "boundElements": [], + "updated": 1723781297836, + "link": null, + "locked": false, + "startBinding": null, + "endBinding": null, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 54.92248363954485, + 0 + ] + ] + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/static/diagrams/TensorRT-LLM.excalidraw b/static/diagrams/TensorRT-LLM.excalidraw new file mode 100644 index 0000000..0f1cd3a --- /dev/null +++ b/static/diagrams/TensorRT-LLM.excalidraw @@ -0,0 +1,902 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "type": "rectangle", + "version": 2327, + "versionNonce": 2127335902, + "index": "b0Z", + "isDeleted": false, + "id": "15aEgI5gEseBuqvZT3RYq", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -757.9666270495253, + "y": -407.1063881085986, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 1124.107240957476, + "height": 484.8674928890096, + "seed": 1684839618, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [], + "updated": 1723790540639, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 2087, + "versionNonce": 544172546, + "index": "b0a", + "isDeleted": false, + "id": "AzlliO_THd-9-yLKxkTfC", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -276.54110060653454, + "y": -377.1817774896958, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 613.075916729433, + "height": 425.018271651204, + "seed": 2144983362, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "lx6DHzG1QbcwSrIBXcqNy", + "type": "arrow" + }, + { + "id": "_H9H7lLoCmxfxP-IUlGPC", + "type": "arrow" + } + ], + "updated": 1723790540943, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1249, + "versionNonce": 1652073090, + "index": "b0cG", + "isDeleted": false, + "id": "Og32EQcHDFKCFOQbiMPpv", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -499.038035662633, + "y": -206.37680062197109, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 1414834690, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "pkkz2sABDwyIkxNf1Mgpp", + "type": "text" + }, + { + "id": "_H9H7lLoCmxfxP-IUlGPC", + "type": "arrow" + } + ], + "updated": 1723790540943, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1232, + "versionNonce": 1516385950, + "index": "b0e", + "isDeleted": false, + "id": "pkkz2sABDwyIkxNf1Mgpp", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -489.43799904153923, + "y": -184.87680062197109, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 115.7999267578125, + "height": 25, + "seed": 234101186, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790540639, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex-CPP", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "Og32EQcHDFKCFOQbiMPpv", + "originalText": "Cortex-CPP", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 897, + "versionNonce": 878555870, + "index": "b22", + "isDeleted": false, + "id": "F5f4ZS9iQ9K9Dj31JLjfQ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -276.4779083282994, + "y": -377.90788296291566, + "strokeColor": "transparent", + "backgroundColor": "#ced4da", + "width": 280.721264400488, + "height": 60, + "seed": 668182722, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "type": "text", + "id": "RHP1cHjPBWKxalwSUHXgg" + } + ], + "updated": 1723790540639, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 823, + "versionNonce": 1914677022, + "index": "b23", + "isDeleted": false, + "id": "RHP1cHjPBWKxalwSUHXgg", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -262.6571931202429, + "y": -360.40788296291566, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 253.079833984375, + "height": 25, + "seed": 2124759170, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790540639, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex.tensorrt-llm engine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "F5f4ZS9iQ9K9Dj31JLjfQ", + "originalText": "Cortex.tensorrt-llm engine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1413, + "versionNonce": 1142494046, + "index": "b25", + "isDeleted": false, + "id": "Aw2ZlTU6l5BMCcmY4FiJv", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -204.78564067937106, + "y": -293.5929738219832, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 807414722, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Z-MpYo1W46a40f5AiVTNF", + "type": "text" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + } + ], + "updated": 1723790540639, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1434, + "versionNonce": 614135710, + "index": "b26", + "isDeleted": false, + "id": "Z-MpYo1W46a40f5AiVTNF", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -146.7580893929889, + "y": -264.22967428390416, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 66.89994812011719, + "height": 25, + "seed": 1885954946, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790540639, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Enginei", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "Aw2ZlTU6l5BMCcmY4FiJv", + "originalText": "Enginei", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1682, + "versionNonce": 276751426, + "index": "b2B", + "isDeleted": false, + "id": "4_vGQ87flHdrX9uilm9tO", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -19.62772197998072, + "y": -9.807764167256575, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 97.05417162174615, + "height": 0, + "seed": 145886082, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790540943, + "link": null, + "locked": false, + "startBinding": { + "elementId": "VakeDQdXXWMfy3HCR0yfr", + "focus": 0.47614878283378975, + "gap": 2.20286800650878, + "fixedPoint": null + }, + "endBinding": { + "elementId": "yMc2IldSW8sPtZKKZjsdw", + "focus": -0.5226520655022306, + "gap": 2.991304475313086, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 97.05417162174615, + 0 + ] + ], + "elbowed": false + }, + { + "type": "rectangle", + "version": 1562, + "versionNonce": 895290370, + "index": "b2E", + "isDeleted": false, + "id": "yMc2IldSW8sPtZKKZjsdw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 80.41775411707852, + "y": -73.55100367765124, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1944375710, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "1vV-R8riWK3RYETly_zT_", + "type": "text" + }, + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + }, + { + "id": "4_vGQ87flHdrX9uilm9tO", + "type": "arrow" + } + ], + "updated": 1723790540943, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1601, + "versionNonce": 1072380062, + "index": "b2F", + "isDeleted": false, + "id": "1vV-R8riWK3RYETly_zT_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 123.73531394838257, + "y": -44.187704139572176, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 96.31993103027344, + "height": 25, + "seed": 1187061570, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790540639, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Tokenizer", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "yMc2IldSW8sPtZKKZjsdw", + "originalText": "Tokenizer", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1682, + "versionNonce": 1165391070, + "index": "b2G", + "isDeleted": false, + "id": "aY6uwi_eAgdAEEgC_5aK6", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 80.41775411707852, + "y": -294.56636424790963, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 225.7842294336452, + "height": 83.72659907615812, + "seed": 1186112706, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "NF9eosH2wx4gCO_pN5UHU", + "type": "text" + }, + { + "id": "VaODIFu3UfbZRvnItRfVk", + "type": "arrow" + } + ], + "updated": 1723790540639, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1708, + "versionNonce": 651176222, + "index": "b2H", + "isDeleted": false, + "id": "NF9eosH2wx4gCO_pN5UHU", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 101.44992925870582, + "y": -265.2030647098306, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 183.71987915039062, + "height": 25, + "seed": 1615117442, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790540639, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Nvidia_tensorrt-llm", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "aY6uwi_eAgdAEEgC_5aK6", + "originalText": "Nvidia_tensorrt-llm", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1740, + "versionNonce": 252101762, + "index": "b2I", + "isDeleted": false, + "id": "VakeDQdXXWMfy3HCR0yfr", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -247.61481942013472, + "y": -71.60422282579833, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 225.7842294336452, + "height": 83.72659907615812, + "seed": 1226275650, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Qfe5YWOsbXJmVByTtSXqu", + "type": "text" + }, + { + "id": "VaODIFu3UfbZRvnItRfVk", + "type": "arrow" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + }, + { + "id": "4_vGQ87flHdrX9uilm9tO", + "type": "arrow" + } + ], + "updated": 1723790540943, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1784, + "versionNonce": 561911262, + "index": "b2J", + "isDeleted": false, + "id": "Qfe5YWOsbXJmVByTtSXqu", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -230.44263725946445, + "y": -42.24092328771927, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 191.4398651123047, + "height": 25, + "seed": 483050242, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790540639, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Tensorrt-llm_engine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "VakeDQdXXWMfy3HCR0yfr", + "originalText": "Tensorrt-llm_engine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "VaODIFu3UfbZRvnItRfVk", + "type": "arrow", + "x": 75.41775411707852, + "y": -252.80306470983058, + "width": 92.24834410356794, + "height": 211.78730784403515, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e9ecef", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b2K", + "roundness": null, + "seed": 1409030366, + "version": 94, + "versionNonce": 694645634, + "isDeleted": false, + "boundElements": null, + "updated": 1723790540943, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + -36.124172051784015, + 0 + ], + [ + -36.124172051784015, + 211.78730784403515 + ], + [ + -92.24834410356794, + 211.78730784403515 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "aY6uwi_eAgdAEEgC_5aK6", + "focus": 0.002388727145337262, + "gap": 5, + "fixedPoint": [ + -0.02214503649144143, + 0.4988056364273312 + ] + }, + "endBinding": { + "elementId": "VakeDQdXXWMfy3HCR0yfr", + "focus": -0.26932501027112093, + "gap": 5.000000000000071, + "fixedPoint": [ + 1.0221450364914415, + 0.36533749486443956 + ] + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": true + }, + { + "type": "arrow", + "version": 1851, + "versionNonce": 1688075010, + "index": "b2L", + "isDeleted": false, + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "dashed", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -113.07320286891974, + "y": -202.5390685006935, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 0, + "height": 126.48125630154587, + "seed": 713478430, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790540943, + "link": null, + "locked": false, + "startBinding": { + "elementId": "Aw2ZlTU6l5BMCcmY4FiJv", + "focus": -0.002567980092606306, + "gap": 7.327306245131595, + "fixedPoint": null + }, + "endBinding": { + "elementId": "VakeDQdXXWMfy3HCR0yfr", + "focus": 0.19177160325765666, + "gap": 4.453589373349303, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 0, + 126.48125630154587 + ] + ], + "elbowed": false + }, + { + "type": "rectangle", + "version": 1315, + "versionNonce": 2963166, + "index": "b2M", + "isDeleted": false, + "id": "jemDA5DKEVKFnGJmGO7ni", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -725.2759078824425, + "y": -206.37680062197109, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 732242178, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "yJmXxUNJl51sSdU23ijpa", + "type": "text" + }, + { + "id": "lx6DHzG1QbcwSrIBXcqNy", + "type": "arrow" + } + ], + "updated": 1723790540640, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1300, + "versionNonce": 559852318, + "index": "b2N", + "isDeleted": false, + "id": "yJmXxUNJl51sSdU23ijpa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -707.5958770596886, + "y": -184.87680062197109, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 99.63993835449219, + "height": 25, + "seed": 840806594, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790540640, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex-JS", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "jemDA5DKEVKFnGJmGO7ni", + "originalText": "Cortex-JS", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1873, + "versionNonce": 369427010, + "index": "b2O", + "isDeleted": false, + "id": "_H9H7lLoCmxfxP-IUlGPC", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -359.8914146519804, + "y": -171.17731917064899, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 78.45591624474321, + "height": 0, + "seed": 1282852638, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790540943, + "link": null, + "locked": false, + "startBinding": { + "elementId": "Og32EQcHDFKCFOQbiMPpv", + "focus": 0.035278866215355885, + "gap": 4.146621010652552, + "fixedPoint": null + }, + "endBinding": { + "elementId": "AzlliO_THd-9-yLKxkTfC", + "focus": 0.03060893114681588, + "gap": 4.894397800702677, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 78.45591624474321, + 0 + ] + ], + "elbowed": false + }, + { + "type": "arrow", + "version": 2052, + "versionNonce": 146201026, + "index": "b2P", + "isDeleted": false, + "id": "lx6DHzG1QbcwSrIBXcqNy", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": -587.2352628611795, + "y": -171.17731917064899, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 82.91363875864909, + "height": 2.842170943040401e-14, + "seed": 681453662, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723790540943, + "link": null, + "locked": false, + "startBinding": { + "elementId": "jemDA5DKEVKFnGJmGO7ni", + "focus": 0.03527886621535657, + "gap": 3.0406450212630034, + "fixedPoint": null + }, + "endBinding": null, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 82.91363875864909, + -2.842170943040401e-14 + ] + ], + "elbowed": false + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/static/diagrams/benchmarking.excalidraw b/static/diagrams/benchmarking.excalidraw new file mode 100644 index 0000000..c379dac --- /dev/null +++ b/static/diagrams/benchmarking.excalidraw @@ -0,0 +1,1277 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "id": "Xgw31mj045JzSvbPzNxcv", + "type": "rectangle", + "x": 789.6438600540419, + "y": 170.72251083414614, + "width": 569.7050111844687, + "height": 520.3799019910081, + "angle": 0, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "Zx", + "roundness": { + "type": 3 + }, + "seed": 612313118, + "version": 200, + "versionNonce": 1419572510, + "isDeleted": false, + "boundElements": [], + "updated": 1723780082988, + "link": null, + "locked": false + }, + { + "id": "zl3DmKvV4WGhejgBiLI1w", + "type": "rectangle", + "x": 507, + "y": 382.5, + "width": 161, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0V", + "roundness": { + "type": 3 + }, + "seed": 1454906526, + "version": 210, + "versionNonce": 525700382, + "isDeleted": false, + "boundElements": [ + { + "id": "XaxeFuoi4m7E5aV43wUPq", + "type": "text" + }, + { + "id": "VbrBtDRvEW2hBpksHfRsY", + "type": "arrow" + }, + { + "id": "FC8G8sAnR6GbfS-zP99Qu", + "type": "arrow" + } + ], + "updated": 1723779651974, + "link": null, + "locked": false + }, + { + "id": "XaxeFuoi4m7E5aV43wUPq", + "type": "text", + "x": 546.5400238037109, + "y": 404, + "width": 81.91995239257812, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0X", + "roundness": null, + "seed": 956750046, + "version": 167, + "versionNonce": 307794818, + "isDeleted": false, + "boundElements": null, + "updated": 1723779440595, + "link": null, + "locked": false, + "text": "Desktop", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "zl3DmKvV4WGhejgBiLI1w", + "originalText": "Desktop", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "RrBf499NO_zr3V_3ejb1f", + "type": "rectangle", + "x": 507, + "y": 252, + "width": 161, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0Z", + "roundness": { + "type": 3 + }, + "seed": 1144904386, + "version": 236, + "versionNonce": 2122979870, + "isDeleted": false, + "boundElements": [ + { + "id": "aNz48iiaEaR5kaCETmdMi", + "type": "text" + }, + { + "id": "Pmv--bT7Rk8Qe7WAOOpKn", + "type": "arrow" + }, + { + "id": "9n2Pv4LB3XN13sCcQT7uX", + "type": "arrow" + } + ], + "updated": 1723779685488, + "link": null, + "locked": false + }, + { + "id": "aNz48iiaEaR5kaCETmdMi", + "type": "text", + "x": 528.5400466918945, + "y": 273.5, + "width": 117.91990661621094, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0a", + "roundness": null, + "seed": 855192194, + "version": 212, + "versionNonce": 329050718, + "isDeleted": false, + "boundElements": null, + "updated": 1723779585415, + "link": null, + "locked": false, + "text": "Workstation", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "RrBf499NO_zr3V_3ejb1f", + "originalText": "Workstation", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "L-ifncPmPKOKoJ-8xWmOf", + "type": "rectangle", + "x": 507, + "y": 513, + "width": 161, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0b", + "roundness": { + "type": 3 + }, + "seed": 2135247042, + "version": 290, + "versionNonce": 1497672350, + "isDeleted": false, + "boundElements": [ + { + "type": "text", + "id": "F6ZCk1b7g_rGAUHuChLH2" + }, + { + "id": "-usoXtg2uN5NMPCmtNw2r", + "type": "arrow" + }, + { + "id": "9n2Pv4LB3XN13sCcQT7uX", + "type": "arrow" + } + ], + "updated": 1723779685488, + "link": null, + "locked": false + }, + { + "id": "F6ZCk1b7g_rGAUHuChLH2", + "type": "text", + "x": 556.1700210571289, + "y": 534.5, + "width": 62.65995788574219, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0c", + "roundness": null, + "seed": 263398494, + "version": 247, + "versionNonce": 736639170, + "isDeleted": false, + "boundElements": null, + "updated": 1723779587193, + "link": null, + "locked": false, + "text": "Server", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "L-ifncPmPKOKoJ-8xWmOf", + "originalText": "Server", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "I_Od4_VKgNWaoY4h3JJES", + "type": "rectangle", + "x": 294.12881005640327, + "y": 382.5, + "width": 135, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0d", + "roundness": { + "type": 3 + }, + "seed": 382778562, + "version": 235, + "versionNonce": 357400670, + "isDeleted": false, + "boundElements": [ + { + "id": "L2I3zwdDJ0_buJb30EFXL", + "type": "text" + }, + { + "id": "zgn1uzVN_qQAmiMw_Bqd_", + "type": "arrow" + }, + { + "id": "VbrBtDRvEW2hBpksHfRsY", + "type": "arrow" + } + ], + "updated": 1723779700100, + "link": null, + "locked": false + }, + { + "id": "L2I3zwdDJ0_buJb30EFXL", + "type": "text", + "x": 339.02882684107124, + "y": 404, + "width": 45.19996643066406, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0e", + "roundness": null, + "seed": 887084162, + "version": 205, + "versionNonce": 247055518, + "isDeleted": false, + "boundElements": null, + "updated": 1723779700100, + "link": null, + "locked": false, + "text": "User", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "I_Od4_VKgNWaoY4h3JJES", + "originalText": "User", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "nsngbeMJBOBgA1KxJ2DPw", + "type": "rectangle", + "x": 846.5, + "y": 252, + "width": 161, + "height": 113.00000000000003, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0fV", + "roundness": { + "type": 3 + }, + "seed": 1701972034, + "version": 456, + "versionNonce": 286032158, + "isDeleted": false, + "boundElements": [ + { + "id": "iCXr3a552uNR3rs7MyoJu", + "type": "text" + }, + { + "id": "EFRqp_cwGttEDcSWap9Ze", + "type": "arrow" + }, + { + "id": "SuZXInrJZw7R-hynLgeQx", + "type": "arrow" + }, + { + "id": "-usoXtg2uN5NMPCmtNw2r", + "type": "arrow" + }, + { + "id": "Pmv--bT7Rk8Qe7WAOOpKn", + "type": "arrow" + }, + { + "id": "4zkILxVnpmhsQaFHR_JZ2", + "type": "arrow" + } + ], + "updated": 1723779638507, + "link": null, + "locked": false + }, + { + "id": "iCXr3a552uNR3rs7MyoJu", + "type": "text", + "x": 881.4300384521484, + "y": 283.5, + "width": 91.13992309570312, + "height": 50, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0gV", + "roundness": null, + "seed": 1212919810, + "version": 444, + "versionNonce": 2080403486, + "isDeleted": false, + "boundElements": null, + "updated": 1723779631107, + "link": null, + "locked": false, + "text": "Supabase\nBackend", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "nsngbeMJBOBgA1KxJ2DPw", + "originalText": "Supabase\nBackend", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "KHKCe-Qi85nc7n-eucLeO", + "type": "rectangle", + "x": 1093, + "y": 251, + "width": 161, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0h", + "roundness": { + "type": 3 + }, + "seed": 1863095618, + "version": 406, + "versionNonce": 522421314, + "isDeleted": false, + "boundElements": [ + { + "id": "_g5FEHR1r5pz503AXodO1", + "type": "text" + }, + { + "id": "EFRqp_cwGttEDcSWap9Ze", + "type": "arrow" + } + ], + "updated": 1723779519786, + "link": null, + "locked": false + }, + { + "id": "_g5FEHR1r5pz503AXodO1", + "type": "text", + "x": 1129.0200271606445, + "y": 272.5, + "width": 88.95994567871094, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0i", + "roundness": null, + "seed": 957127938, + "version": 392, + "versionNonce": 21163586, + "isDeleted": false, + "boundElements": null, + "updated": 1723779493650, + "link": null, + "locked": false, + "text": "Postgres", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "KHKCe-Qi85nc7n-eucLeO", + "originalText": "Postgres", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "MjC7YTIL30gjDIlLPpg4w", + "type": "rectangle", + "x": 846.5, + "y": 440.5, + "width": 161, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0j", + "roundness": { + "type": 3 + }, + "seed": 1792554078, + "version": 292, + "versionNonce": 1175828894, + "isDeleted": false, + "boundElements": [ + { + "id": "bDMNAfR2pkdBe82sKhZ_L", + "type": "text" + }, + { + "id": "SuZXInrJZw7R-hynLgeQx", + "type": "arrow" + } + ], + "updated": 1723779729204, + "link": null, + "locked": false + }, + { + "id": "bDMNAfR2pkdBe82sKhZ_L", + "type": "text", + "x": 914.2800064086914, + "y": 462, + "width": 25.439987182617188, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0k", + "roundness": null, + "seed": 1221458078, + "version": 251, + "versionNonce": 517095362, + "isDeleted": false, + "boundElements": null, + "updated": 1723779729204, + "link": null, + "locked": false, + "text": "S3", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "MjC7YTIL30gjDIlLPpg4w", + "originalText": "S3", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "mBs4RnKS-FUcqH16bvBao", + "type": "rectangle", + "x": 730.6288100564032, + "y": 622.3711899435967, + "width": 107, + "height": 68, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0l", + "roundness": { + "type": 3 + }, + "seed": 804671518, + "version": 455, + "versionNonce": 567939778, + "isDeleted": false, + "boundElements": [ + { + "id": "2l1_xOEbOnbK1KIguaD0l", + "type": "text" + }, + { + "id": "zgn1uzVN_qQAmiMw_Bqd_", + "type": "arrow" + } + ], + "updated": 1723779716415, + "link": null, + "locked": false + }, + { + "id": "2l1_xOEbOnbK1KIguaD0l", + "type": "text", + "x": 765.6488295876532, + "y": 643.8711899435967, + "width": 36.9599609375, + "height": 25, + "angle": 0, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0m", + "roundness": null, + "seed": 1127390302, + "version": 392, + "versionNonce": 5139074, + "isDeleted": false, + "boundElements": null, + "updated": 1723779716415, + "link": null, + "locked": false, + "text": "Web", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "mBs4RnKS-FUcqH16bvBao", + "originalText": "Web", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "id": "EFRqp_cwGttEDcSWap9Ze", + "type": "arrow", + "x": 1011.5, + "y": 287.53442485306465, + "width": 75.5, + "height": 0.5344248530646496, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0n", + "roundness": null, + "seed": 1678503042, + "version": 127, + "versionNonce": 378841282, + "isDeleted": false, + "boundElements": null, + "updated": 1723779631107, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 75.5, + -0.5344248530646496 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "nsngbeMJBOBgA1KxJ2DPw", + "focus": -0.3568864420719145, + "gap": 4, + "fixedPoint": null + }, + "endBinding": { + "elementId": "KHKCe-Qi85nc7n-eucLeO", + "focus": -0.04014229853111693, + "gap": 6, + "fixedPoint": null + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": false + }, + { + "id": "SuZXInrJZw7R-hynLgeQx", + "type": "arrow", + "x": 925, + "y": 366, + "width": 1.6556467636894467, + "height": 74.2331277298365, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0o", + "roundness": null, + "seed": 943888990, + "version": 160, + "versionNonce": 507778398, + "isDeleted": false, + "boundElements": null, + "updated": 1723779729204, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 1.6556467636894467, + 74.2331277298365 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "nsngbeMJBOBgA1KxJ2DPw", + "focus": 0.024844720496894408, + "gap": 1, + "fixedPoint": null + }, + "endBinding": { + "elementId": "MjC7YTIL30gjDIlLPpg4w", + "focus": -0.024844720496894408, + "gap": 1.5, + "fixedPoint": null + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": false + }, + { + "id": "zgn1uzVN_qQAmiMw_Bqd_", + "type": "arrow", + "x": 361.52881005640324, + "y": 455.5, + "width": 364.0999999999999, + "height": 200.7711899435967, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0p", + "roundness": null, + "seed": 667723934, + "version": 176, + "versionNonce": 98683458, + "isDeleted": false, + "boundElements": null, + "updated": 1723779716415, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 0, + 200.7711899435967 + ], + [ + 364.0999999999999, + 200.7711899435967 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "I_Od4_VKgNWaoY4h3JJES", + "focus": 0.0014814814814818184, + "gap": 5, + "fixedPoint": [ + 0.49925925925925907, + 1.0735294117647058 + ] + }, + "endBinding": { + "elementId": "mBs4RnKS-FUcqH16bvBao", + "focus": 0.0029411764705889044, + "gap": 5, + "fixedPoint": [ + -0.04672897196261682, + 0.49852941176470555 + ] + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": true + }, + { + "id": "VbrBtDRvEW2hBpksHfRsY", + "type": "arrow", + "x": 432.12881005640327, + "y": 414, + "width": 70.87118994359673, + "height": 0, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0q", + "roundness": null, + "seed": 676736542, + "version": 89, + "versionNonce": 611038494, + "isDeleted": false, + "boundElements": null, + "updated": 1723779700100, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 70.87118994359673, + 0 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "I_Od4_VKgNWaoY4h3JJES", + "focus": -0.07352941176470591, + "gap": 3, + "fixedPoint": null + }, + "endBinding": { + "elementId": "zl3DmKvV4WGhejgBiLI1w", + "focus": 0.07352941176470588, + "gap": 4, + "fixedPoint": null + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": false + }, + { + "id": "-usoXtg2uN5NMPCmtNw2r", + "type": "arrow", + "x": 673, + "y": 546.9, + "width": 168.5, + "height": 203.89999999999998, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0t", + "roundness": null, + "seed": 930462174, + "version": 40, + "versionNonce": 1903091778, + "isDeleted": false, + "boundElements": null, + "updated": 1723779631108, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 74.25, + 0 + ], + [ + 74.25, + -203.89999999999998 + ], + [ + 168.5, + -203.89999999999998 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "L-ifncPmPKOKoJ-8xWmOf", + "focus": -0.002941176470588904, + "gap": 5, + "fixedPoint": [ + 1.031055900621118, + 0.49852941176470555 + ] + }, + "endBinding": { + "elementId": "nsngbeMJBOBgA1KxJ2DPw", + "focus": -0.6106194690265485, + "gap": 5, + "fixedPoint": [ + -0.031055900621118012, + 0.8053097345132741 + ] + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": true + }, + { + "id": "Pmv--bT7Rk8Qe7WAOOpKn", + "type": "arrow", + "x": 671, + "y": 277, + "width": 170, + "height": 0, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0u", + "roundness": null, + "seed": 1686788126, + "version": 43, + "versionNonce": 1861060610, + "isDeleted": false, + "boundElements": null, + "updated": 1723779631108, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 170, + 0 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "RrBf499NO_zr3V_3ejb1f", + "focus": -0.2647058823529412, + "gap": 3, + "fixedPoint": null + }, + "endBinding": { + "elementId": "nsngbeMJBOBgA1KxJ2DPw", + "focus": 0.5575221238938052, + "gap": 5.5, + "fixedPoint": null + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": false + }, + { + "id": "4zkILxVnpmhsQaFHR_JZ2", + "type": "arrow", + "x": 720, + "y": 309, + "width": 120, + "height": 0, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0w", + "roundness": null, + "seed": 1138793822, + "version": 64, + "versionNonce": 375246046, + "isDeleted": false, + "boundElements": null, + "updated": 1723779638507, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 120, + 0 + ] + ], + "lastCommittedPoint": null, + "startBinding": null, + "endBinding": { + "elementId": "nsngbeMJBOBgA1KxJ2DPw", + "focus": -0.008849557522123892, + "gap": 6.5, + "fixedPoint": null + }, + "startArrowhead": null, + "endArrowhead": "triangle", + "elbowed": false + }, + { + "id": "FC8G8sAnR6GbfS-zP99Qu", + "type": "arrow", + "x": 673, + "y": 416.4, + "width": 46.98572975859838, + "height": 106.39999999999998, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0x", + "roundness": null, + "seed": 1033458078, + "version": 56, + "versionNonce": 152996034, + "isDeleted": false, + "boundElements": null, + "updated": 1723779665327, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + 46.98572975859838, + 0 + ], + [ + 46.98572975859838, + -106.39999999999998 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "zl3DmKvV4WGhejgBiLI1w", + "focus": -0.0029411764705889044, + "gap": 5, + "fixedPoint": [ + 1.031055900621118, + 0.49852941176470555 + ] + }, + "endBinding": null, + "startArrowhead": null, + "endArrowhead": null, + "elbowed": true + }, + { + "id": "9n2Pv4LB3XN13sCcQT7uX", + "type": "arrow", + "x": 502, + "y": 285.9, + "width": 35, + "height": 261, + "angle": 0, + "strokeColor": "#868e96", + "backgroundColor": "#e7f5ff", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b0y", + "roundness": null, + "seed": 396206238, + "version": 44, + "versionNonce": 475581378, + "isDeleted": false, + "boundElements": [], + "updated": 1723779694582, + "link": null, + "locked": false, + "points": [ + [ + 0, + 0 + ], + [ + -35, + 0 + ], + [ + -35, + 261 + ], + [ + 0, + 261 + ] + ], + "lastCommittedPoint": null, + "startBinding": { + "elementId": "RrBf499NO_zr3V_3ejb1f", + "focus": 0.002941176470588904, + "gap": 5, + "fixedPoint": [ + -0.031055900621118012, + 0.49852941176470555 + ] + }, + "endBinding": { + "elementId": "L-ifncPmPKOKoJ-8xWmOf", + "focus": 0.002941176470588904, + "gap": 5, + "fixedPoint": [ + -0.031055900621118012, + 0.49852941176470555 + ] + }, + "startArrowhead": "triangle", + "endArrowhead": "triangle", + "elbowed": true + }, + { + "id": "PbgwVbSBSzUMOE2-1uA1V", + "type": "rectangle", + "x": 788.052442437627, + "y": 171.27272985205602, + "width": 124.11412154334516, + "height": 42.746467408772624, + "angle": 0, + "strokeColor": "transparent", + "backgroundColor": "#ced4da", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b16", + "roundness": { + "type": 3 + }, + "seed": 19444510, + "version": 304, + "versionNonce": 369982366, + "isDeleted": false, + "boundElements": [ + { + "type": "text", + "id": "uwkduaCPSI34zdgL71Cu5" + } + ], + "updated": 1723780195576, + "link": null, + "locked": false + }, + { + "id": "uwkduaCPSI34zdgL71Cu5", + "type": "text", + "x": 804.1295303699441, + "y": 180.14596355644233, + "width": 91.95994567871094, + "height": 25, + "angle": 0, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b17", + "roundness": null, + "seed": 382691486, + "version": 171, + "versionNonce": 1146640350, + "isDeleted": false, + "boundElements": null, + "updated": 1723780195576, + "link": null, + "locked": false, + "text": "Jan cloud", + "fontSize": 20, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "PbgwVbSBSzUMOE2-1uA1V", + "originalText": "Jan cloud", + "autoResize": true, + "lineHeight": 1.25 + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/static/diagrams/llamacpp1.excalidraw b/static/diagrams/llamacpp1.excalidraw new file mode 100644 index 0000000..9db9a75 --- /dev/null +++ b/static/diagrams/llamacpp1.excalidraw @@ -0,0 +1,886 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "type": "rectangle", + "version": 2074, + "versionNonce": 100074178, + "index": "b0Z", + "isDeleted": false, + "id": "15aEgI5gEseBuqvZT3RYq", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 27.135593636485737, + "y": -375.7216918508061, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 221.99050609981487, + "height": 425.018271651204, + "seed": 1684839618, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723790061055, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1974, + "versionNonce": 1535294018, + "index": "b0a", + "isDeleted": false, + "id": "AzlliO_THd-9-yLKxkTfC", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 334.4504671115319, + "y": -375.7216918508061, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 634.4905060998149, + "height": 425.018271651204, + "seed": 2144983362, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723790061055, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1082, + "versionNonce": 1568023042, + "index": "b0cG", + "isDeleted": false, + "id": "jemDA5DKEVKFnGJmGO7ni", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 70.63084668639317, + "y": -205.28464925852933, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 732242178, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "yJmXxUNJl51sSdU23ijpa", + "type": "text" + } + ], + "updated": 1723790061055, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1067, + "versionNonce": 1680249282, + "index": "b0e", + "isDeleted": false, + "id": "yJmXxUNJl51sSdU23ijpa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 85.96087903502598, + "y": -183.78464925852933, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 104.33993530273438, + "height": 25, + "seed": 840806594, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790061055, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex.cpp", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "jemDA5DKEVKFnGJmGO7ni", + "originalText": "Cortex.cpp", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1111, + "versionNonce": 2123353502, + "index": "b1Q8", + "isDeleted": false, + "id": "7JjoPn2r6z19MHfiPCycO", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 747.1904812794169, + "y": -286.2974502637795, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 649902914, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "206KBtr0MwBLqkj04q0vD", + "type": "text" + }, + { + "id": "5PfTTRLUnHygabygbyOyj", + "type": "arrow" + }, + { + "id": "4O8gsja4iCRgWlgb9Gfmp", + "type": "arrow" + } + ], + "updated": 1723790061173, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1121, + "versionNonce": 274368834, + "index": "b1QG", + "isDeleted": false, + "id": "206KBtr0MwBLqkj04q0vD", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 774.8280560643343, + "y": -269.4341507257004, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 127.67990112304688, + "height": 50, + "seed": 331875074, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790061055, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "LLama Server\nContext", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "7JjoPn2r6z19MHfiPCycO", + "originalText": "LLama Server\nContext", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1205, + "versionNonce": 770837662, + "index": "b1RZ", + "isDeleted": false, + "id": "5PfTTRLUnHygabygbyOyj", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 833.8944032551763, + "y": -76.07830005218017, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 0, + "height": 116.98389035520404, + "seed": 395596482, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "iPZIlzMPXNFlbqj0_GSNI", + "type": "text" + } + ], + "updated": 1723790061173, + "link": null, + "locked": false, + "startBinding": { + "elementId": "h8JWAOGZnFRfKKFbN7IXw", + "focus": -0.052183346156369374, + "gap": 6.476591963189264, + "fixedPoint": null + }, + "endBinding": { + "elementId": "7JjoPn2r6z19MHfiPCycO", + "focus": 0.052183346156369374, + "gap": 9.508660780237207, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 0, + -116.98389035520404 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 79, + "versionNonce": 194301150, + "index": "b1Rt", + "isDeleted": false, + "id": "iPZIlzMPXNFlbqj0_GSNI", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1364.1824205281255, + "y": 399.4297547702178, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 91.42396545410156, + "height": 20, + "seed": 1153477250, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790054497, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Dependency", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "5PfTTRLUnHygabygbyOyj", + "originalText": "Dependency", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1129, + "versionNonce": 105461890, + "index": "b1j", + "isDeleted": false, + "id": "h8JWAOGZnFRfKKFbN7IXw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 747.1904812794169, + "y": -69.6017080889909, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1691793054, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "j8SCNxso-IEXhmMRY-oOd", + "type": "text" + }, + { + "id": "5PfTTRLUnHygabygbyOyj", + "type": "arrow" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + } + ], + "updated": 1723790061055, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1158, + "versionNonce": 287905986, + "index": "b1k", + "isDeleted": false, + "id": "j8SCNxso-IEXhmMRY-oOd", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 807.5880276829865, + "y": -52.73840855091184, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 62.15995788574219, + "height": 50, + "seed": 2084713182, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790065609, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "LLama\nEngine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "h8JWAOGZnFRfKKFbN7IXw", + "originalText": "LLama\nEngine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1174, + "versionNonce": 1097902430, + "index": "b1w", + "isDeleted": false, + "id": "4O8gsja4iCRgWlgb9Gfmp", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 559.3802439709634, + "y": -245.87274668155578, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 184, + "height": 0, + "seed": 1174753538, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "ORYiH4ASUK-WVWHcB5Yw4", + "type": "text" + } + ], + "updated": 1723790061173, + "link": null, + "locked": false, + "startBinding": { + "elementId": "VakeDQdXXWMfy3HCR0yfr", + "focus": -0.01047686065586771, + "gap": 6.234711998665034, + "fixedPoint": null + }, + "endBinding": { + "elementId": "7JjoPn2r6z19MHfiPCycO", + "focus": 0.03436413210924169, + "gap": 3.810237308453452, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 184, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 68, + "versionNonce": 936488286, + "index": "b1x", + "isDeleted": false, + "id": "ORYiH4ASUK-WVWHcB5Yw4", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1190.7575457103949, + "y": 289.1272533184442, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 91.42396545410156, + "height": 20, + "seed": 1895293122, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790054497, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Dependency", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "4O8gsja4iCRgWlgb9Gfmp", + "originalText": "Dependency", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1829, + "versionNonce": 2064875038, + "index": "b1y", + "isDeleted": false, + "id": "81V7OQs6AhX6Y4QY0cbKw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 252.8802439709633, + "y": -28.079412461570882, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 132.1785689329646, + "height": 0, + "seed": 1082629982, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790061173, + "link": null, + "locked": false, + "startBinding": { + "elementId": "15aEgI5gEseBuqvZT3RYq", + "focus": 0.6358933371906033, + "gap": 3.7541442346627036, + "fixedPoint": null + }, + "endBinding": { + "elementId": "yMc2IldSW8sPtZKKZjsdw", + "focus": 0.008145652980574587, + "gap": 3.131668375488971, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 132.1785689329646, + 0 + ] + ], + "elbowed": false + }, + { + "type": "rectangle", + "version": 741, + "versionNonce": 746155778, + "index": "b22", + "isDeleted": false, + "id": "F5f4ZS9iQ9K9Dj31JLjfQ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 334.5136593897671, + "y": -377.90788296291566, + "strokeColor": "transparent", + "backgroundColor": "#ced4da", + "width": 177.8641215433451, + "height": 60, + "seed": 668182722, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "type": "text", + "id": "RHP1cHjPBWKxalwSUHXgg" + } + ], + "updated": 1723790061055, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 637, + "versionNonce": 1865957058, + "index": "b23", + "isDeleted": false, + "id": "RHP1cHjPBWKxalwSUHXgg", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 348.62576624298254, + "y": -360.40788296291566, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 149.63990783691406, + "height": 25, + "seed": 2124759170, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790061055, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex.llamacpp", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "F5f4ZS9iQ9K9Dj31JLjfQ", + "originalText": "Cortex.llamacpp", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1319, + "versionNonce": 2016541982, + "index": "b25", + "isDeleted": false, + "id": "VakeDQdXXWMfy3HCR0yfr", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 370.1904812794169, + "y": -287.2974502637795, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1226275650, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Qfe5YWOsbXJmVByTtSXqu", + "type": "text" + }, + { + "id": "4O8gsja4iCRgWlgb9Gfmp", + "type": "arrow" + } + ], + "updated": 1723790061173, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1342, + "versionNonce": 447018562, + "index": "b26", + "isDeleted": false, + "id": "Qfe5YWOsbXJmVByTtSXqu", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 414.00804874011544, + "y": -257.9341507257005, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 95.31991577148438, + "height": 25, + "seed": 483050242, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790061055, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "LLama.cpp", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "VakeDQdXXWMfy3HCR0yfr", + "originalText": "LLama.cpp", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1318, + "versionNonce": 1961942530, + "index": "b29", + "isDeleted": false, + "id": "yMc2IldSW8sPtZKKZjsdw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 388.1904812794169, + "y": -69.6017080889909, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1944375710, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "1vV-R8riWK3RYETly_zT_", + "type": "text" + }, + { + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "type": "arrow" + }, + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723790061055, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1349, + "versionNonce": 887737794, + "index": "b2A", + "isDeleted": false, + "id": "1vV-R8riWK3RYETly_zT_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 446.21803256579904, + "y": -40.238408550911856, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 66.89994812011719, + "height": 25, + "seed": 1187061570, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790061055, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Enginei", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "yMc2IldSW8sPtZKKZjsdw", + "originalText": "Enginei", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1345, + "versionNonce": 1170542238, + "index": "b2B", + "isDeleted": false, + "id": "LEhf2Zfw7HUjqT8O0xg1_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 572.3802439709634, + "y": -25.872746681555782, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 172, + "height": 0, + "seed": 713478430, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "Ioh_8UJOGuzFDhZUHlwX6", + "type": "text" + } + ], + "updated": 1723790061173, + "link": null, + "locked": false, + "startBinding": { + "elementId": "yMc2IldSW8sPtZKKZjsdw", + "focus": 0.04456557151351734, + "gap": 1.2347119986650341, + "fixedPoint": null + }, + "endBinding": { + "elementId": "h8JWAOGZnFRfKKFbN7IXw", + "focus": -0.04456557151351735, + "gap": 2.810237308453452, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 172, + 0 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 78, + "versionNonce": 1282150018, + "index": "b2C", + "isDeleted": false, + "id": "Ioh_8UJOGuzFDhZUHlwX6", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1189.8002726574869, + "y": 508.1272533184442, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 89.15994262695312, + "height": 20, + "seed": 2047540574, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723790054497, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Inheritance", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "LEhf2Zfw7HUjqT8O0xg1_", + "originalText": "Inheritance", + "autoResize": true, + "lineHeight": 1.25 + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/static/diagrams/llamacpp2.excalidraw b/static/diagrams/llamacpp2.excalidraw new file mode 100644 index 0000000..caf93da --- /dev/null +++ b/static/diagrams/llamacpp2.excalidraw @@ -0,0 +1,1009 @@ +{ + "type": "excalidraw", + "version": 2, + "source": "https://excalidraw.com", + "elements": [ + { + "type": "rectangle", + "version": 2012, + "versionNonce": 2128902302, + "index": "b0Z", + "isDeleted": false, + "id": "15aEgI5gEseBuqvZT3RYq", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 619.7775296211296, + "y": 168.2783081491939, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 221.99050609981487, + "height": 425.018271651204, + "seed": 1684839618, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723789978814, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1912, + "versionNonce": 206570654, + "index": "b0a", + "isDeleted": false, + "id": "AzlliO_THd-9-yLKxkTfC", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 998.8350351659496, + "y": 166.14517266131668, + "strokeColor": "#ced4da", + "backgroundColor": "#f8f9fa", + "width": 556.1059380453972, + "height": 440.95708278488695, + "seed": 2144983362, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723789965657, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1964, + "versionNonce": 1491109122, + "index": "b0a2", + "isDeleted": false, + "id": "2k5QDihYrW1sEPAnI9k7S", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1026.6128497016978, + "y": 453.7935165031703, + "strokeColor": "#ced4da", + "backgroundColor": "#e9ecef", + "width": 498.6316949382202, + "height": 123.76827165120403, + "seed": 775844418, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723789954388, + "link": null, + "locked": false + }, + { + "type": "rectangle", + "version": 1020, + "versionNonce": 1752787230, + "index": "b0cG", + "isDeleted": false, + "id": "jemDA5DKEVKFnGJmGO7ni", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 663.272782671037, + "y": 337.7153507414707, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 135, + "height": 68, + "seed": 732242178, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "yJmXxUNJl51sSdU23ijpa", + "type": "text" + } + ], + "updated": 1723789978814, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1005, + "versionNonce": 233477470, + "index": "b0e", + "isDeleted": false, + "id": "yJmXxUNJl51sSdU23ijpa", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 678.6028150196698, + "y": 359.2153507414707, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 104.33993530273438, + "height": 25, + "seed": 840806594, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789978814, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex.cpp", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "jemDA5DKEVKFnGJmGO7ni", + "originalText": "Cortex.cpp", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1048, + "versionNonce": 1633831070, + "index": "b1Q8", + "isDeleted": false, + "id": "7JjoPn2r6z19MHfiPCycO", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1323.1904812794169, + "y": 257.7025497362205, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 649902914, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "206KBtr0MwBLqkj04q0vD", + "type": "text" + }, + { + "id": "5PfTTRLUnHygabygbyOyj", + "type": "arrow" + }, + { + "id": "4O8gsja4iCRgWlgb9Gfmp", + "type": "arrow" + } + ], + "updated": 1723789789931, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1060, + "versionNonce": 993222914, + "index": "b1QG", + "isDeleted": false, + "id": "206KBtr0MwBLqkj04q0vD", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1350.8280560643343, + "y": 274.5658492742996, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 127.67990112304688, + "height": 50, + "seed": 331875074, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789526473, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "LLama Server\nContext", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "7JjoPn2r6z19MHfiPCycO", + "originalText": "LLama Server\nContext", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 945, + "versionNonce": 439493278, + "index": "b1RZ", + "isDeleted": false, + "id": "N_RQL_i8qodAkqCXVO6BS", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1461.4493902737916, + "y": 467.92169994781983, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 0, + "height": 116.98389035520404, + "seed": 1361502622, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "etNLplPGSFShzYwnIzCFs", + "type": "text" + } + ], + "updated": 1723789893213, + "link": null, + "locked": false, + "startBinding": { + "elementId": "h8JWAOGZnFRfKKFbN7IXw", + "focus": 0.5113975642734633, + "gap": 6.476591963189321, + "fixedPoint": null + }, + "endBinding": { + "elementId": "7JjoPn2r6z19MHfiPCycO", + "focus": -0.5113975642734633, + "gap": 9.508660780237221, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 0, + -116.98389035520404 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 71, + "versionNonce": 1341759070, + "index": "b1Rt", + "isDeleted": false, + "id": "etNLplPGSFShzYwnIzCFs", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1377.9624269368169, + "y": 399.4297547702178, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 63.86395263671875, + "height": 20, + "seed": 1666514398, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789893213, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Call API", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "N_RQL_i8qodAkqCXVO6BS", + "originalText": "Call API", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1067, + "versionNonce": 840647106, + "index": "b1j", + "isDeleted": false, + "id": "h8JWAOGZnFRfKKFbN7IXw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1323.1904812794169, + "y": 474.3982919110091, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1691793054, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "j8SCNxso-IEXhmMRY-oOd", + "type": "text" + }, + { + "id": "5PfTTRLUnHygabygbyOyj", + "type": "arrow" + } + ], + "updated": 1723789810529, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1092, + "versionNonce": 2104794370, + "index": "b1k", + "isDeleted": false, + "id": "j8SCNxso-IEXhmMRY-oOd", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1383.5880276829866, + "y": 491.26159144908814, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 62.15995788574219, + "height": 50, + "seed": 2084713182, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789925053, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "LLama\nEngine", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "h8JWAOGZnFRfKKFbN7IXw", + "originalText": "LLama\nEngine", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1110, + "versionNonce": 2025432578, + "index": "b1w", + "isDeleted": false, + "id": "4O8gsja4iCRgWlgb9Gfmp", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1236.2412389464089, + "y": 296.56177476568394, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 83.13900502455454, + "height": 0.5654785527602826, + "seed": 1174753538, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789945000, + "link": null, + "locked": false, + "startBinding": { + "elementId": "VakeDQdXXWMfy3HCR0yfr", + "focus": -0.03436413210924169, + "gap": 6.23471199866492, + "fixedPoint": null + }, + "endBinding": { + "elementId": "7JjoPn2r6z19MHfiPCycO", + "focus": 0.058251403562615676, + "gap": 3.8102373084535657, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 83.13900502455454, + 0.5654785527602826 + ] + ], + "elbowed": false + }, + { + "type": "arrow", + "version": 1612, + "versionNonce": 1054395778, + "index": "b1y", + "isDeleted": false, + "id": "wmKoAQPpJtMT1Wc7u9bdS", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 845.5221799556072, + "y": 551.0477876626207, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 173.1148657373567, + "height": 0, + "seed": 1937055362, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "B6EERUjcXuqh-lJN5G9qp", + "type": "text" + } + ], + "updated": 1723789983390, + "link": null, + "locked": false, + "startBinding": { + "elementId": "15aEgI5gEseBuqvZT3RYq", + "focus": 0.801190701879052, + "gap": 3.7541442346627036, + "fixedPoint": null + }, + "endBinding": { + "elementId": "2k5QDihYrW1sEPAnI9k7S", + "focus": -0.5715541610458348, + "gap": 7.9758040087340305, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": null, + "endArrowhead": "triangle", + "points": [ + [ + 0, + 0 + ], + [ + 173.1148657373567, + 0 + ] + ], + "elbowed": false + }, + { + "id": "B6EERUjcXuqh-lJN5G9qp", + "type": "text", + "x": 862.9495546825628, + "y": 505.9205875384291, + "width": 64.03994750976562, + "height": 20, + "angle": 0, + "strokeColor": "#1e1e1e", + "backgroundColor": "#e9ecef", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b1yV", + "roundness": null, + "seed": 1242693186, + "version": 10, + "versionNonce": 582276546, + "isDeleted": false, + "boundElements": null, + "updated": 1723789983390, + "link": null, + "locked": false, + "text": "Request", + "fontSize": 16, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "wmKoAQPpJtMT1Wc7u9bdS", + "originalText": "Request", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 679, + "versionNonce": 2099096130, + "index": "b22", + "isDeleted": false, + "id": "F5f4ZS9iQ9K9Dj31JLjfQ", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1001.1644984199389, + "y": 164.95898154920718, + "strokeColor": "transparent", + "backgroundColor": "#ced4da", + "width": 177.8641215433451, + "height": 60, + "seed": 668182722, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "type": "text", + "id": "RHP1cHjPBWKxalwSUHXgg" + } + ], + "updated": 1723789969045, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 575, + "versionNonce": 1848840706, + "index": "b23", + "isDeleted": false, + "id": "RHP1cHjPBWKxalwSUHXgg", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1015.2766052731545, + "y": 182.45898154920718, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 149.63990783691406, + "height": 25, + "seed": 2124759170, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789969045, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Cortex.llamacpp", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "F5f4ZS9iQ9K9Dj31JLjfQ", + "originalText": "Cortex.llamacpp", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1256, + "versionNonce": 249683586, + "index": "b25", + "isDeleted": false, + "id": "VakeDQdXXWMfy3HCR0yfr", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1047.0514762548623, + "y": 255.49385243391202, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1226275650, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "Qfe5YWOsbXJmVByTtSXqu", + "type": "text" + }, + { + "id": "4O8gsja4iCRgWlgb9Gfmp", + "type": "arrow" + } + ], + "updated": 1723789945000, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1280, + "versionNonce": 1508294210, + "index": "b26", + "isDeleted": false, + "id": "Qfe5YWOsbXJmVByTtSXqu", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1090.869043715561, + "y": 284.8571519719911, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 95.31991577148438, + "height": 25, + "seed": 483050242, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789945000, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "LLama.cpp", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "VakeDQdXXWMfy3HCR0yfr", + "originalText": "LLama.cpp", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "rectangle", + "version": 1256, + "versionNonce": 1415157186, + "index": "b29", + "isDeleted": false, + "id": "yMc2IldSW8sPtZKKZjsdw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1047.0514762548623, + "y": 474.3982919110091, + "strokeColor": "#228be6", + "backgroundColor": "#e7f5ff", + "width": 182.95505069288154, + "height": 83.72659907615812, + "seed": 1944375710, + "groupIds": [], + "frameId": null, + "roundness": { + "type": 3 + }, + "boundElements": [ + { + "id": "1vV-R8riWK3RYETly_zT_", + "type": "text" + }, + { + "id": "81V7OQs6AhX6Y4QY0cbKw", + "type": "arrow" + } + ], + "updated": 1723789945000, + "link": null, + "locked": false + }, + { + "type": "text", + "version": 1287, + "versionNonce": 1575325058, + "index": "b2A", + "isDeleted": false, + "id": "1vV-R8riWK3RYETly_zT_", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1105.0790275412446, + "y": 503.76159144908814, + "strokeColor": "#228be6", + "backgroundColor": "transparent", + "width": 66.89994812011719, + "height": 25, + "seed": 1187061570, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [], + "updated": 1723789945000, + "link": null, + "locked": false, + "fontSize": 20, + "fontFamily": 5, + "text": "Enginei", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "yMc2IldSW8sPtZKKZjsdw", + "originalText": "Enginei", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1019, + "versionNonce": 269790722, + "index": "b2F", + "isDeleted": false, + "id": "5PfTTRLUnHygabygbyOyj", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1368.811522974717, + "y": 467.92169994781983, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 0, + "height": 116.98389035520404, + "seed": 395596482, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "id": "iPZIlzMPXNFlbqj0_GSNI", + "type": "text" + } + ], + "updated": 1723789917883, + "link": null, + "locked": false, + "startBinding": { + "elementId": "h8JWAOGZnFRfKKFbN7IXw", + "focus": -0.5012868841551463, + "gap": 6.476591963189321, + "fixedPoint": null + }, + "endBinding": { + "elementId": "7JjoPn2r6z19MHfiPCycO", + "focus": 0.5012868841551462, + "gap": 9.508660780237221, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 0, + -116.98389035520404 + ] + ], + "elbowed": false + }, + { + "type": "text", + "version": 78, + "versionNonce": 1211053214, + "index": "b2G", + "isDeleted": false, + "id": "iPZIlzMPXNFlbqj0_GSNI", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 1359.7104813203782, + "y": 399.4297547702178, + "strokeColor": "#1e1e1e", + "backgroundColor": "#ced4da", + "width": 50.4239501953125, + "height": 20, + "seed": 1153477250, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": null, + "updated": 1723789912084, + "link": null, + "locked": false, + "fontSize": 16, + "fontFamily": 5, + "text": "Result", + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "5PfTTRLUnHygabygbyOyj", + "originalText": "Result", + "autoResize": true, + "lineHeight": 1.25 + }, + { + "type": "arrow", + "version": 1643, + "versionNonce": 898301726, + "index": "b2H", + "isDeleted": false, + "id": "81V7OQs6AhX6Y4QY0cbKw", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 1, + "opacity": 100, + "angle": 0, + "x": 845.5221799556072, + "y": 493.25787778088613, + "strokeColor": "#868e96", + "backgroundColor": "#ced4da", + "width": 173.1148657373567, + "height": 0, + "seed": 1082629982, + "groupIds": [], + "frameId": null, + "roundness": null, + "boundElements": [ + { + "type": "text", + "id": "rWtiFKEIHuFtX4F0KRMCw" + } + ], + "updated": 1723789994650, + "link": null, + "locked": false, + "startBinding": { + "elementId": "15aEgI5gEseBuqvZT3RYq", + "focus": 0.5292498761012814, + "gap": 3.7541442346627036, + "fixedPoint": null + }, + "endBinding": { + "elementId": "2k5QDihYrW1sEPAnI9k7S", + "focus": 0.3622862992070885, + "gap": 7.9758040087340305, + "fixedPoint": null + }, + "lastCommittedPoint": null, + "startArrowhead": "triangle", + "endArrowhead": null, + "points": [ + [ + 0, + 0 + ], + [ + 173.1148657373567, + 0 + ] + ], + "elbowed": false + }, + { + "id": "rWtiFKEIHuFtX4F0KRMCw", + "type": "text", + "x": 895.4036408394222, + "y": 483.25787778088613, + "width": 73.35194396972656, + "height": 20, + "angle": 0, + "strokeColor": "#1e1e1e", + "backgroundColor": "#e9ecef", + "fillStyle": "solid", + "strokeWidth": 2, + "strokeStyle": "solid", + "roughness": 0, + "opacity": 100, + "groupIds": [], + "frameId": null, + "index": "b2I", + "roundness": null, + "seed": 284783582, + "version": 19, + "versionNonce": 408160990, + "isDeleted": false, + "boundElements": null, + "updated": 1723789992900, + "link": null, + "locked": false, + "text": "Response", + "fontSize": 16, + "fontFamily": 5, + "textAlign": "center", + "verticalAlign": "middle", + "containerId": "81V7OQs6AhX6Y4QY0cbKw", + "originalText": "Response", + "autoResize": true, + "lineHeight": 1.25 + } + ], + "appState": { + "gridSize": 20, + "gridStep": 5, + "gridModeEnabled": false, + "viewBackgroundColor": "#ffffff" + }, + "files": {} +} \ No newline at end of file diff --git a/yarn.lock b/yarn.lock index 27e749e..eedd713 100644 --- a/yarn.lock +++ b/yarn.lock @@ -2002,6 +2002,11 @@ resolved "https://registry.yarnpkg.com/@esbuild/win32-x64/-/win32-x64-0.21.5.tgz#acad351d582d157bb145535db2a6ff53dd514b5c" integrity sha512-tQd/1efJuzPC6rCFwEvLtci/xNFcTZknmXs98FYDfGE4wP9ClFV98nyKrzJKVPMhdDnjzLhdUyMX4PsQAPjwIw== +"@excalidraw/excalidraw@^0.17.6": + version "0.17.6" + resolved "https://registry.yarnpkg.com/@excalidraw/excalidraw/-/excalidraw-0.17.6.tgz#5fd208ce69d33ca712d1804b50d7d06d5c46ac4d" + integrity sha512-fyCl+zG/Z5yhHDh5Fq2ZGmphcrALmuOdtITm8gN4d8w4ntnaopTXcTfnAAaU3VleDC6LhTkoLOTG6P5kgREiIg== + "@floating-ui/core@^1.0.0": version "1.6.2" resolved "https://registry.yarnpkg.com/@floating-ui/core/-/core-1.6.2.tgz#d37f3e0ac1f1c756c7de45db13303a266226851a" @@ -5437,6 +5442,13 @@ dns-packet@^5.2.2: dependencies: "@leichtgewicht/ip-codec" "^2.0.1" +docusaurus-plugin-dotenv@^1.0.1: + version "1.0.1" + resolved "https://registry.yarnpkg.com/docusaurus-plugin-dotenv/-/docusaurus-plugin-dotenv-1.0.1.tgz#e0aff6f006fd438d1e981ae2afd7b7a6bd2aa76f" + integrity sha512-qKlWuBd6UoyB0d5ExH9waYGPoy1SnWgV8s8VLg12ydcfxquazXJngV0N5VAX/HuFiZmsPD3L4TYUKxdHWJTeEw== + dependencies: + dotenv-webpack "7.0.2" + docusaurus-plugin-sass@^0.2.5: version "0.2.5" resolved "https://registry.yarnpkg.com/docusaurus-plugin-sass/-/docusaurus-plugin-sass-0.2.5.tgz#6bfb8a227ac6265be685dcbc24ba1989e27b8005" @@ -5536,11 +5548,30 @@ dot-prop@^6.0.1: dependencies: is-obj "^2.0.0" +dotenv-defaults@^2.0.1: + version "2.0.2" + resolved "https://registry.yarnpkg.com/dotenv-defaults/-/dotenv-defaults-2.0.2.tgz#6b3ec2e4319aafb70940abda72d3856770ee77ac" + integrity sha512-iOIzovWfsUHU91L5i8bJce3NYK5JXeAwH50Jh6+ARUdLiiGlYWfGw6UkzsYqaXZH/hjE/eCd/PlfM/qqyK0AMg== + dependencies: + dotenv "^8.2.0" + +dotenv-webpack@7.0.2: + version "7.0.2" + resolved "https://registry.yarnpkg.com/dotenv-webpack/-/dotenv-webpack-7.0.2.tgz#1bf2e407e92c10fbb08d815b12c991028f10f81c" + integrity sha512-RY+/5uM/XY4bGtih9f9ic8hlrUDxVcZZBPWlnX/aHhaKxcVVX9SH/5VH7CSmvVo9GL6PKvQOA0X1bc552rnatQ== + dependencies: + dotenv-defaults "^2.0.1" + dotenv@^16.4.5: version "16.4.5" resolved "https://registry.yarnpkg.com/dotenv/-/dotenv-16.4.5.tgz#cdd3b3b604cb327e286b4762e13502f717cb099f" integrity sha512-ZmdL2rui+eB2YwhsWzjInR8LldtZHGDoQ1ugH85ppHKwpUHL7j7rN0Ti9NCnGiQbhaZ11FpR+7ao1dNsmduNUg== +dotenv@^8.2.0: + version "8.6.0" + resolved "https://registry.yarnpkg.com/dotenv/-/dotenv-8.6.0.tgz#061af664d19f7f4d8fc6e4ff9b584ce237adcb8b" + integrity sha512-IrPdXQsk2BbzvCBGBOTmmSH5SodmqZNt4ERAZDmW4CT+tL8VtvinqywuANaFu4bOMWki16nqf0e4oC0QIaDr/g== + duplexer@^0.1.2: version "0.1.2" resolved "https://registry.yarnpkg.com/duplexer/-/duplexer-0.1.2.tgz#3abe43aef3835f8ae077d136ddce0f276b0400e6"