Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
tan-xu authored Oct 25, 2023
1 parent e7c4ba3 commit 468386c
Showing 1 changed file with 9 additions and 6 deletions.
15 changes: 9 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ We summarize the scope of our Muzic project in the following figure:
<br/>


The current work in [Muzic](https://www.microsoft.com/en-us/research/project/ai-music/) include:
The current work in [Muzic](https://www.microsoft.com/en-us/research/project/ai-music/) includes:
* Music Understanding
+ Symbolic Music Understanding: [MusicBERT](https://arxiv.org/abs/2106.05630)
+ Automatic Lyrics Transcription: [PDAugment](https://arxiv.org/abs/2109.07940)
Expand All @@ -42,17 +42,19 @@ The current work in [Muzic](https://www.microsoft.com/en-us/research/project/ai-
+ Any Track Music Generation: [GETMusic](https://arxiv.org/abs/2305.10841)
+ Text-to-Music Generation: [MuseCoco](https://arxiv.org/abs/2306.00110)
+ Singing Voice Synthesis: [HiFiSinger](https://arxiv.org/abs/2009.01776)
* AI Agent for Music
+ [MusicAgent](https://arxiv.org/abs/2310.11954)


You can find some music samples generated by our systems from this page: https://ai-muzic.github.io/.
You can find some music samples generated by our systems on this page: https://ai-muzic.github.io/.
<br>
For more speech related research, you can find from this page: https://speechresearch.github.io/ and https://github.com/microsoft/NeuralSpeech.

### We are hiring!
We are hiring both research FTEs and research interns on **AI music, speech, audio, language, and machine learning**. Please contact Xu Tan ([email protected]) if you have interests.
We are hiring both research FTEs and research interns on **AI music, speech, audio, language, and machine learning**. Please get in touch with Xu Tan ([email protected]) if you are interested.


### What is New!
### What is New?
+ We release [MusicAgent](https://arxiv.org/abs/2310.11954), an AI agent for versatile music processing using large language models.
+ We release [MuseCoco](https://arxiv.org/abs/2306.00110), a music composition copilot to generate symbolic music from text.
+ We release [GETMusic](https://arxiv.org/abs/2305.10841), a versatile music copliot with a universal representation and diffusion framework to generate any music tracks.
+ We release the first model for cross-modal symbolic MIR: [CLaMP](https://arxiv.org/abs/2304.11029).
Expand All @@ -66,7 +68,7 @@ The operating system is Linux. We test on Ubuntu 16.04.6 LTS, CUDA 10, with Pyth
```bash
pip install -r requirements.txt
```
We release the code of several research work: [MusicBERT](musicbert), [PDAugment](pdaugment), [CLaMP](clamp), [DeepRapper](deeprapper), [SongMASS](songmass), [TeleMelody](telemelody), [ReLyMe](relyme), [Re-creation of Creations (ROC)](roc), [MeloForm](meloform), [Museformer](museformer), [GETMusic](getmusic), and [MuseCoco](musecoco). You can find the README in the corresponding folder for detailed instructions on how to use.
We release the code of several research work: [MusicBERT](musicbert), [PDAugment](pdaugment), [CLaMP](clamp), [DeepRapper](deeprapper), [SongMASS](songmass), [TeleMelody](telemelody), [ReLyMe](relyme), [Re-creation of Creations (ROC)](roc), [MeloForm](meloform), [Museformer](museformer), [GETMusic](getmusic), [MuseCoco](musecoco), and [MusicAgent](agent). You can find the README in the corresponding folder for detailed instructions on how to use.



Expand All @@ -88,6 +90,7 @@ If you find the Muzic project useful in your work, you can cite the papers as fo
* [12] ***CLaMP**: Contrastive Language-Music Pre-training for Cross-Modal Symbolic Music Information Retrieval*, Shangda Wu, Dingyao Yu, Xu Tan, Maosong Sun, **ISMIR 2023**.
* [13] ***GETMusic**: Generating Any Music Tracks with a Unified Representation and Diffusion Framework*, Ang Lv, Xu Tan, Peiling Lu, Wei Ye, Shikun Zhang, Jiang Bian, Rui Yan, arXiv 2023.
* [14] ***MuseCoco**: Generating Symbolic Music from Text*, Peiling Lu, Xin Xu, Chenfei Kang, Botao Yu, Chengyi Xing, Xu Tan, Jiang Bian, arXiv 2023.
* [15] ***MusicAgent**: An AI Agent for Music Understanding and Generation with Large Language Models*, Dingyao Yu, Kaitao Song, Peiling Lu, Tianyu He, Xu Tan, Wei Ye, Shikun Zhang, Jiang Bian, arXiv 2023.


## Contributing
Expand Down

0 comments on commit 468386c

Please sign in to comment.