Skip to content

wpf535236337/LLMs4TS

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

53 Commits
 
 
 
 

Repository files navigation

AI4TS

Awesome resources focus on the application of cutting-edge AI technologies for time-series analysis (AI4TS). They delve into advanced topics such as self-supervised learning (SSL), Graph Neural Networks for Time Series (GNN4TS), Large Language Models for Time Series (LLM4TS), Diffusion models, Mixture-of-Experts (MoE) architectures and Mamba models, Kolmogorov Arnold Networks (KAN), Learn at Test Time (TTT) among others. These resources span various domains, including healthcare, finance, and traffic, offering a comprehensive view of the field. In addition, they feature top-notch tutorials, courses, and workshops from prestigious conferences, hosted by globally renowned scholars and research teams. Whether you're a professional, data scientist, or researcher, these tools and techniques can significantly enhance your time-series data analysis capabilities, providing a clear roadmap for your studies.

LLM4TS

Vision4TS

  • Time Series as Images: Vision Transformer for Irregularly Sampled Time Series Neurips 2023 ViTST
  • VisionTS: Visual Masked Autoencoders Are Free-Lunch Zero-Shot Time Series Forecasters 30 Aug 2024 Keytoyze/VisionTS
  • CAFO: Feature-Centric Explanation on Time Series Classification KDD2024
  • ViTime: A Visual Intelligence-Based Foundation Model for Time Series Forecasting 10 Jul 2024 IkeYang/ViTime
  • Hierarchical Context Representation and Self-Adaptive Thresholding for Multivariate Anomaly Detection TKDE2024
  • Training-Free Time-Series Anomaly Detection: Leveraging Image Foundation Models 27 Aug 2024

Multimodal large models include TS

Patch && Tokenizers methods

GNN

  • Graph-Aware Contrasting for Multivariate Time-Series Classification AAAI2024 TSGAC
  • GinAR: An End-To-End Multivariate Time Series Forecasting Model Suitable for Variable Missing KDD2024

MLPer

  • TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting KDD2023PatchTSMixer
  • A Multi-Scale Decomposition MLP-Mixer for Time Series Analysis VLDB2024 zshhans/MSD-Mixer
  • Tiny Time Mixers (TTMs): Fast Pre-trained Models for Enhanced Zero/Few-Shot Forecasting of Multivariate Time Series 8 Jan 2024
  • U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecasting AAAI2024 U-Mixer
  • LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation—Extended Version SIGMOD 2023
  • An Analysis of Linear Time Series Forecasting Models ICML2024
  • SOFTS: Efficient Multivariate Time Series Forecasting with Series-Core Fusion 22 Apr 2024 Secilia-Cxy/SOFTS

Mixture-of-Experts (MoE)

PEFT for TS

  • One Fits All: Universal Time Series Analysis by Pretrained LM and Specially Designed Adaptors 24 Nov 2023 GPT4TS_Adapter
  • Low-Rank Adaptation of Time Series Foundational Models for Out-of-Domain Modality Forecasting 16 May 2024
  • Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models 24 May 2024
  • DualTime: A Dual-Adapter Multimodal Language Model for Time Series Representation 7 Jun 2024
  • Channel-Aware Low-Rank Adaptation in Time Series Forecasting CIKM2024 C-LoRA

Mamba

  • Is Mamba Effective for Time Series Forecasting? 17 Mar 2024 wzhwzhwzh0921/S-D-Mamba
  • TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting 14 Mar 2024 Atik-Ahamed/TimeMachine
  • STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model 19 Mar 2024
  • SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series 22 Mar 2024 badripatro/simba
  • MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection 29 Mar 2024
  • Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models 8 May 2024
  • Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting 25 May 2024
  • TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification 6 Jun 2024
  • A Mamba Foundation Model for Time Series Forecasting 5 Nov 2024

KAN

TTT

Multiple instance learning

  • TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learning ICML2024 xiwenc1/TimeMIL

NeXt (Classic networks make a comeback)

Federated learning

  • PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection SIGKDD 2024 PeFAD
  • Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting NeurIPS24

Biosignal dataset

  • Neuro-GPT: Developing A Foundation Model for EEG arxiv 7 Nov 2023
  • Brant: Foundation Model for Intracranial Neural Signal NeurIPS23
  • Brant-2: Foundation Model for Brain Signals 15 Feb 2024
  • Brant-X: A Unified Physiological Signal Alignment Framework KDD2024
  • PPi: Pretraining Brain Signal Model for Patient-independent Seizure Detection NeurIPS23
  • Large-scale training of foundation models for wearable biosignals submit ICLR 2024
  • BIOT: Cross-data Biosignal Learning in the Wild NeurIPS23 BIOT
  • Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI submit ICLR 2024
  • Practical intelligent diagnostic algorithm for wearable 12-lead ECG via self-supervised learning on large-scale dataset Nature Communications 2023
  • Large AI Models in Health Informatics: Applications, Challenges, and the Future IEEE Journal of Biomedical and Health Informatics Awesome-Healthcare-Foundation-Models
  • Data science opportunities of large language models for neuroscience and biomedicine Neuron
  • BioSignal Copilot: Leveraging the power of LLMs in drafting reports for biomedical signals July 06, 2023
  • Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data 12 Jan 2024
  • Self-supervised Learning for Electroencephalogram: A Systematic Survey 9 Jan 2024
  • Learning Topology-Agnostic EEG Representations with Geometry-Aware Modeling NeurIPS 2023 MMM
  • A Survey of Large Language Models in Medicine: Progress, Application, and Challenge 9 Nov 2023 AI-in-Health/MedLLMsPracticalGuide
  • EEG-GPT: Exploring Capabilities of Large Language Models for EEG Classification and Interpretation 31 Jan 2024
  • A Survey on Multimodal Wearable Sensor-based Human Action Recognition 14 Apr 2024
  • Unveiling Thoughts: A Review of Advancements in EEG Brain Signal Decoding into Text 26 Apr 2024
  • AI for Biomedicine in the Era of Large Language Models 23 Mar 2024
  • NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signals 27 Aug 2024
  • EEG-Language Modeling for Pathology Detection 2 Sep 2024
  • Interpretable and Robust AI in EEG Systems: A Survey 21 Apr 2023
  • A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications 26 Sep 2024
  • NeuroLM: A Universal Multi-task Foundation Model for Bridging the Gap between Language and EEG Signals 27 Aug 2024
  • Repurposing Foundation Model for Generalizable Medical Time Series Classification 3 Oct 2024 FORMED
  • A Survey of Few-Shot Learning for Biomedical Time Series 3 May 2024

Foundation for other domains

Multimodal TS

Small && Efficient Language Model

Benchmark && Analysis

Survey4TS

Workshop

Project

Self-supervised learning tools

Blog list

Laboratory and Researcher Resources

Medicine Domain
General Domain
Lab and Resource

Course

Others

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published