Pinned Loading

1. janhq/jan janhq/jan Public

   Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

   TypeScript 24.4k 1.4k

2. janhq/cortex.cpp janhq/cortex.cpp Public

   Local AI API Platform

   C++ 2.2k 134

3. janhq/awesome-local-ai janhq/awesome-local-ai Public

   An awesome repository of local AI tools

   1.3k 105

4. janhq/cortex.tensorrt-llm janhq/cortex.tensorrt-llm Public

   Forked from NVIDIA/TensorRT-LLM

   Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU accelerated inference on NVIDIA's GPUs.

   C++ 41 2