You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

133 rivejä
8.2 KiB

2 vuotta sitten
  1. <img src="https://github.com/deezer/spleeter/raw/master/images/spleeter_logo.png" height="80" />
  2. [![Github actions](https://github.com/deezer/spleeter/workflows/pytest/badge.svg)](https://github.com/deezer/spleeter/actions) ![PyPI - Python Version](https://img.shields.io/pypi/pyversions/spleeter) [![PyPI version](https://badge.fury.io/py/spleeter.svg)](https://badge.fury.io/py/spleeter) [![Conda](https://img.shields.io/conda/vn/deezer-research/spleeter)](https://anaconda.org/deezer-research/spleeter) [![Docker Pulls](https://img.shields.io/docker/pulls/deezer/spleeter)](https://hub.docker.com/r/researchdeezer/spleeter) [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deezer/spleeter/blob/master/spleeter.ipynb) [![Gitter chat](https://badges.gitter.im/gitterHQ/gitter.png)](https://gitter.im/spleeter/community) [![status](https://joss.theoj.org/papers/259e5efe669945a343bad6eccb89018b/status.svg)](https://joss.theoj.org/papers/259e5efe669945a343bad6eccb89018b)
  3. > :warning: [Spleeter 2.1.0](https://pypi.org/project/spleeter/) release introduces some breaking changes, including new CLI option naming for input, and the drop
  4. > of dedicated GPU package. Please read [CHANGELOG](CHANGELOG.md) for more details.
  5. ## About
  6. **Spleeter** is [Deezer](https://www.deezer.com/) source separation library with pretrained models
  7. written in [Python](https://www.python.org/) and uses [Tensorflow](https://tensorflow.org/). It makes it easy
  8. to train source separation model (assuming you have a dataset of isolated sources), and provides
  9. already trained state of the art model for performing various flavour of separation :
  10. * Vocals (singing voice) / accompaniment separation ([2 stems](https://github.com/deezer/spleeter/wiki/2.-Getting-started#using-2stems-model))
  11. * Vocals / drums / bass / other separation ([4 stems](https://github.com/deezer/spleeter/wiki/2.-Getting-started#using-4stems-model))
  12. * Vocals / drums / bass / piano / other separation ([5 stems](https://github.com/deezer/spleeter/wiki/2.-Getting-started#using-5stems-model))
  13. 2 stems and 4 stems models have [high performances](https://github.com/deezer/spleeter/wiki/Separation-Performances) on the [musdb](https://sigsep.github.io/datasets/musdb.html) dataset. **Spleeter** is also very fast as it can perform separation of audio files to 4 stems 100x faster than real-time when run on a GPU.
  14. We designed **Spleeter** so you can use it straight from [command line](https://github.com/deezer/spleeter/wiki/2.-Getting-started#usage)
  15. as well as directly in your own development pipeline as a [Python library](https://github.com/deezer/spleeter/wiki/4.-API-Reference#separator). It can be installed with [pip](https://github.com/deezer/spleeter/wiki/1.-Installation#using-pip) or be used with
  16. [Docker](https://github.com/deezer/spleeter/wiki/2.-Getting-started#using-docker-image).
  17. ### Projects and Softwares using **Spleeter**
  18. Since it's been released, there are multiple forks exposing **Spleeter** through either a Guided User Interface (GUI) or a standalone free or paying website. Please note that we do not host, maintain or directly support any of these initiatives.
  19. That being said, many cool projects have been built on top of ours. Notably the porting to the *Ableton Live* ecosystem through the [Spleeter 4 Max](https://github.com/diracdeltas/spleeter4max#spleeter-for-max) project.
  20. **Spleeter** pre-trained models have also been used by professionnal audio softwares. Here's a non-exhaustive list:
  21. * [iZotope](https://www.izotope.com/en/shop/rx-8-standard.html) in its *Music Rebalance* feature within **RX 8**
  22. * [SpectralLayers](https://new.steinberg.net/spectralayers/) in its *Unmix* feature in **SpectralLayers 7**
  23. * [Acon Digital](https://acondigital.com/products/acoustica-audio-editor/) within **Acoustica 7**
  24. * [VirtualDJ](https://www.virtualdj.com/stems/) in their stem isolation feature
  25. * [Algoriddim](https://www.algoriddim.com/apps) in their **NeuralMix** and **djayPRO** app suite
  26. 🆕 **Spleeter** is a baseline in the ongoing [Music Demixing Challenge](https://www.aicrowd.com/challenges/music-demixing-challenge-ismir-2021)!
  27. ## Quick start
  28. Want to try it out but don't want to install anything ? We have set up a [Google Colab](https://colab.research.google.com/github/deezer/spleeter/blob/master/spleeter.ipynb).
  29. Ready to dig into it ? In a few lines you can install **Spleeter** and separate the vocal and accompaniment parts from an example audio file.
  30. You need first to install `ffmpeg` and `libsndfile`. It can be done on most platform using [Conda](https://github.com/deezer/spleeter/wiki/1.-Installation#using-conda):
  31. ```bash
  32. # install dependencies using conda
  33. conda install -c conda-forge ffmpeg libsndfile
  34. # install spleeter with pip
  35. pip install spleeter
  36. # download an example audio file (if you don't have wget, use another tool for downloading)
  37. wget https://github.com/deezer/spleeter/raw/master/audio_example.mp3
  38. # separate the example audio into two components
  39. spleeter separate -p spleeter:2stems -o output audio_example.mp3
  40. ```
  41. > :warning: Note that we no longer recommend using `conda` for installing spleeter.
  42. > ⚠️ There are known issues with Apple M1 chips, mostly due to TensorFlow compatibility. Until these are fixed, you can use [this workaround](https://github.com/deezer/spleeter/issues/607#issuecomment-828352392)
  43. You should get two separated audio files (`vocals.wav` and `accompaniment.wav`) in the `output/audio_example` folder.
  44. For a detailed documentation, please check the [repository wiki](https://github.com/deezer/spleeter/wiki/1.-Installation)
  45. ## Development and Testing
  46. This project is managed using [Poetry](https://python-poetry.org/docs/basic-usage/), to run test suite you
  47. can execute the following set of commands:
  48. ```bash
  49. # Clone spleeter repository
  50. git clone https://github.com/Deezer/spleeter && cd spleeter
  51. # Install poetry
  52. pip install poetry
  53. # Install spleeter dependencies
  54. poetry install
  55. # Run unit test suite
  56. poetry run pytest tests/
  57. ```
  58. ## Reference
  59. * Deezer Research - Source Separation Engine Story - deezer.io blog post:
  60. * [English version](https://deezer.io/releasing-spleeter-deezer-r-d-source-separation-engine-2b88985e797e)
  61. * [Japanese version](http://dzr.fm/splitterjp)
  62. * [Music Source Separation tool with pre-trained models / ISMIR2019 extended abstract](http://archives.ismir.net/ismir2019/latebreaking/000036.pdf)
  63. If you use **Spleeter** in your work, please cite:
  64. ```BibTeX
  65. @article{spleeter2020,
  66. doi = {10.21105/joss.02154},
  67. url = {https://doi.org/10.21105/joss.02154},
  68. year = {2020},
  69. publisher = {The Open Journal},
  70. volume = {5},
  71. number = {50},
  72. pages = {2154},
  73. author = {Romain Hennequin and Anis Khlif and Felix Voituret and Manuel Moussallam},
  74. title = {Spleeter: a fast and efficient music source separation tool with pre-trained models},
  75. journal = {Journal of Open Source Software},
  76. note = {Deezer Research}
  77. }
  78. ```
  79. ## License
  80. The code of **Spleeter** is [MIT-licensed](LICENSE).
  81. ## Disclaimer
  82. If you plan to use **Spleeter** on copyrighted material, make sure you get proper authorization from right owners beforehand.
  83. ## Troubleshooting
  84. **Spleeter** is a complex piece of software and although we continously try to improve and test it you may encounter unexpected issues running it. If that's the case please check the [FAQ page](https://github.com/deezer/spleeter/wiki/5.-FAQ) first as well as the list of [currently open issues](https://github.com/deezer/spleeter/issues)
  85. ### Windows users
  86. It appears that sometimes the shortcut command `spleeter` does not work properly on windows. This is a known issue that we will hopefully fix soon. In the meantime replace `spleeter separate` by `python -m spleeter separate` in command line and it should work.
  87. ## Contributing
  88. If you would like to participate in the development of **Spleeter** you are more than welcome to do so. Don't hesitate to throw us a pull request and we'll do our best to examine it quickly. Please check out our [guidelines](.github/CONTRIBUTING.md) first.
  89. ## Note
  90. This repository include a demo audio file `audio_example.mp3` which is an excerpt
  91. from Slow Motion Dream by Steven M Bryant (c) copyright 2011 Licensed under a Creative
  92. Commons Attribution (3.0) [license](http://dig.ccmixter.org/files/stevieb357/34740)
  93. Ft: CSoul,Alex Beroza & Robert Siekawitch