Repositories list

• transformers-openai-api

  Public
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.

  Python

  •2•14•2•0•Updated Nov 15, 2024Nov 15, 2024

• malaysian-dataset

  Public
  We gather Malaysian dataset! https://malaysian-dataset.readthedocs.io/

  text-miningcorpusmalaysia+ 3bahasa-melayumanglishmalay-dataset

  Jupyter Notebook

  •

  Apache License 2.0

  •106•301•9•2•Updated Nov 15, 2024Nov 15, 2024

• malaya-speech

  Public
  Speech Toolkit for Malaysian language, https://malaya-speech.readthedocs.io/

  Jupyter Notebook

  •

  MIT License

  •42•239•6•0•Updated Nov 12, 2024Nov 12, 2024

• dynamic-batch-RAG-pipeline

  Public
  Dynamic batching for Document Layout and OCR, suitable for RAG, with extra tools.

  Jupyter Notebook

  •1•10•0•0•Updated Nov 12, 2024Nov 12, 2024

• malaya

  Public
  Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

  natural-language-processingsentiment-analysistensorflow+ 10language-detectionentity-frameworknormalizerneremotion-analysispos-taggingmalay+ 3

  Jupyter Notebook

  •

  MIT License

  •127•468•3•7•Updated Nov 10, 2024Nov 10, 2024

• nous-chat-widget

  Public
  Vue

  •1•4•0•0•Updated Oct 25, 2024Oct 25, 2024

• context-parallelism

  Public
  Context Parallelism, support Blockwise Attention, Ring Attention and Tree Attention.

  Jupyter Notebook

  •2•2•2•0•Updated Oct 24, 2024Oct 24, 2024

• t5-sdpa-multipack

  Public
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python

  •

  Apache License 2.0

  •27k•2•0•0•Updated Oct 15, 2024Oct 15, 2024

• vllm-entropix

  Public
  vLLM for https://github.com/xjdr-alt/entropix

  Python

  •

  Apache License 2.0

  •4.6k•1•0•0•Updated Oct 5, 2024Oct 5, 2024

• research-paper

  Public
  Preprint under Mesolitica.

  TeX

  •1•1•0•0•Updated Sep 2, 2024Sep 2, 2024

• cookbook

  Public
  cookbooks 📖 for Mesolitica products!

  Jupyter Notebook

  •

  MIT License

  •1•6•0•0•Updated Sep 2, 2024Sep 2, 2024

• chat-widget

  Public
  Customizable Web Chat Widget 💬

  JavaScript

  •0•0•0•0•Updated Aug 25, 2024Aug 25, 2024

• vllm-context-parallelism

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •4.6k•2•0•0•Updated Aug 17, 2024Aug 17, 2024

• more-memory-efficient

  Public
  Learning more memory efficient on top of Llama model!

  Jupyter Notebook

  •2•2•0•0•Updated Aug 2, 2024Aug 2, 2024

• vllm-whisper

  Public
  A high-throughput and memory-efficient inference and serving engine for Whisper, https://mesolitica.com/blog/vllm-whisper

  Python

  •

  Apache License 2.0

  •4.6k•17•0•0•Updated Jul 28, 2024Jul 28, 2024

• t5-sdpa

  Public
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python

  •

  Apache License 2.0

  •27k•0•0•0•Updated Jul 5, 2024Jul 5, 2024

• chat

  Public
  Web Chat, almost same as ChatGPT UI.

  HTML

  •0•1•0•0•Updated Jun 25, 2024Jun 25, 2024

• transformers

  Public
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python

  •

  Apache License 2.0

  •27k•1•0•0•Updated Jun 9, 2024Jun 9, 2024

• t5-static-cache

  Public
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python

  •

  Apache License 2.0

  •27k•0•0•0•Updated May 31, 2024May 31, 2024

• whisper-static-cache

  Public
  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Python

  •

  Apache License 2.0

  •27k•4•0•0•Updated May 14, 2024May 14, 2024

• llm-embedding

  Public
  Finetune Malaysian LLM for Malaysian context embedding task.

  Jupyter Notebook

  •1•20•0•1•Updated Apr 27, 2024Apr 27, 2024

• streaming-playwright-agent

  Public
  Super simple website application streaming Playwright agent using websocket that support multi-users including queue, 100% no LangChain, 100% no LlamaIndex, 100% use available models from HuggingFace.

  Python

  •2•5•0•0•Updated Apr 2, 2024Apr 2, 2024

• llm-benchmarks

  Public
  Benchmarking LLM for Malay tasks.

  Jupyter Notebook

  •5•4•0•0•Updated Apr 1, 2024Apr 1, 2024

• malaya-boilerplate

  Public
  Tensorflow freeze graph optimization and boilerplates to share among Malaya projects.

  Python

  •

  MIT License

  •1•1•0•0•Updated Mar 26, 2024Mar 26, 2024

• multimodal-LLM

  Public
  Multi-Modal Language Modeling with Image, Audio and Text Integration, included multi-images and multi-audio in a single multiturn.

  Jupyter Notebook

  •1•14•0•0•Updated Feb 20, 2024Feb 20, 2024

• embedding-benchmarks

  Public
  Benchmarking Embedding models for Malaysian context.

  Jupyter Notebook

  •1•1•0•0•Updated Feb 15, 2024Feb 15, 2024

• malaysian-stt-benchmarks

  Public
  Benchmarking Malaysian Speech-to-Text models.

  Jupyter Notebook

  •1•6•0•0•Updated Feb 6, 2024Feb 6, 2024

• jgscm

  Public
  Jupyter support for Google Cloud Storage

  Python

  •

  MIT License

  •20•0•0•0•Updated Jul 7, 2021Jul 7, 2021

• NLP-Models-Tensorflow

  Public archive
  Gathers machine learning and Tensorflow deep learning models for NLP problems, 1.13 < Tensorflow < 2.0

  nlpmachine-learningdeep-learning+ 13chatbotlanguage-detectionspeech-to-textdnc-seq2seqembeddedlstmsummarization+ 6

  Jupyter Notebook

  •

  MIT License

  •729•1.8k•8•0•Updated Jul 20, 2020Jul 20, 2020