-
Notifications
You must be signed in to change notification settings - Fork 455
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
1 changed file
with
9 additions
and
6 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -24,7 +24,7 @@ We summarize the scope of our Muzic project in the following figure: | |
<br/> | ||
|
||
|
||
The current work in [Muzic](https://www.microsoft.com/en-us/research/project/ai-music/) include: | ||
The current work in [Muzic](https://www.microsoft.com/en-us/research/project/ai-music/) includes: | ||
* Music Understanding | ||
+ Symbolic Music Understanding: [MusicBERT](https://arxiv.org/abs/2106.05630) | ||
+ Automatic Lyrics Transcription: [PDAugment](https://arxiv.org/abs/2109.07940) | ||
|
@@ -42,17 +42,19 @@ The current work in [Muzic](https://www.microsoft.com/en-us/research/project/ai- | |
+ Any Track Music Generation: [GETMusic](https://arxiv.org/abs/2305.10841) | ||
+ Text-to-Music Generation: [MuseCoco](https://arxiv.org/abs/2306.00110) | ||
+ Singing Voice Synthesis: [HiFiSinger](https://arxiv.org/abs/2009.01776) | ||
* AI Agent for Music | ||
+ [MusicAgent](https://arxiv.org/abs/2310.11954) | ||
|
||
|
||
You can find some music samples generated by our systems from this page: https://ai-muzic.github.io/. | ||
You can find some music samples generated by our systems on this page: https://ai-muzic.github.io/. | ||
<br> | ||
For more speech related research, you can find from this page: https://speechresearch.github.io/ and https://github.com/microsoft/NeuralSpeech. | ||
|
||
### We are hiring! | ||
We are hiring both research FTEs and research interns on **AI music, speech, audio, language, and machine learning**. Please contact Xu Tan ([email protected]) if you have interests. | ||
We are hiring both research FTEs and research interns on **AI music, speech, audio, language, and machine learning**. Please get in touch with Xu Tan ([email protected]) if you are interested. | ||
|
||
|
||
### What is New! | ||
### What is New? | ||
+ We release [MusicAgent](https://arxiv.org/abs/2310.11954), an AI agent for versatile music processing using large language models. | ||
+ We release [MuseCoco](https://arxiv.org/abs/2306.00110), a music composition copilot to generate symbolic music from text. | ||
+ We release [GETMusic](https://arxiv.org/abs/2305.10841), a versatile music copliot with a universal representation and diffusion framework to generate any music tracks. | ||
+ We release the first model for cross-modal symbolic MIR: [CLaMP](https://arxiv.org/abs/2304.11029). | ||
|
@@ -66,7 +68,7 @@ The operating system is Linux. We test on Ubuntu 16.04.6 LTS, CUDA 10, with Pyth | |
```bash | ||
pip install -r requirements.txt | ||
``` | ||
We release the code of several research work: [MusicBERT](musicbert), [PDAugment](pdaugment), [CLaMP](clamp), [DeepRapper](deeprapper), [SongMASS](songmass), [TeleMelody](telemelody), [ReLyMe](relyme), [Re-creation of Creations (ROC)](roc), [MeloForm](meloform), [Museformer](museformer), [GETMusic](getmusic), and [MuseCoco](musecoco). You can find the README in the corresponding folder for detailed instructions on how to use. | ||
We release the code of several research work: [MusicBERT](musicbert), [PDAugment](pdaugment), [CLaMP](clamp), [DeepRapper](deeprapper), [SongMASS](songmass), [TeleMelody](telemelody), [ReLyMe](relyme), [Re-creation of Creations (ROC)](roc), [MeloForm](meloform), [Museformer](museformer), [GETMusic](getmusic), [MuseCoco](musecoco), and [MusicAgent](agent). You can find the README in the corresponding folder for detailed instructions on how to use. | ||
|
||
|
||
|
||
|
@@ -88,6 +90,7 @@ If you find the Muzic project useful in your work, you can cite the papers as fo | |
* [12] ***CLaMP**: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval*, Shangda Wu, Dingyao Yu, Xu Tan, Maosong Sun, **ISMIR 2023**. | ||
* [13] ***GETMusic**: Generating Any Music Tracks with a Unified Representation and Diffusion Framework*, Ang Lv, Xu Tan, Peiling Lu, Wei Ye, Shikun Zhang, Jiang Bian, Rui Yan, arXiv 2023. | ||
* [14] ***MuseCoco**: Generating Symbolic Music from Text*, Peiling Lu, Xin Xu, Chenfei Kang, Botao Yu, Chengyi Xing, Xu Tan, Jiang Bian, arXiv 2023. | ||
* [15] ***MusicAgent**: An AI Agent for Music Understanding and Generation with Large Language Models*, Dingyao Yu, Kaitao Song, Peiling Lu, Tianyu He, Xu Tan, Wei Ye, Shikun Zhang, Jiang Bian, arXiv 2023. | ||
|
||
|
||
## Contributing | ||
|