Expand description

HexoDSP - Comprehensive DSP graph and synthesis library for developing a modular synthesizer in Rust, such as HexoSynth.

This project contains the complete DSP backend of the modular synthesizer HexoSynth.

It’s aimed to provide a toolkit for everyone who wants to develop a synthesizer in Rust. You can use it to quickly define a DSP graph that you can change at runtime. It comes with a (growing) collection of already developed DSP modules/nodes, such as oscillators, filters, amplifiers, envelopes and sequencers.

The DSP graph API also provides multiple kinds of feedback to track what the signals in the DSP threads look like. From monitoring the inputs and outputs of single nodes to get the current output value of all nodes.

There is also an (optional) JIT compiler for defining custom pieces of DSP code that runs at native speed in a DSP graph module/node.

Here a short list of features:

  • Runtime changeable DSP graph.
  • Serialization and loading of the DSP graph and the parameters.
  • Full monitoring and feedback introspection into the running DSP graph.
  • Provides a wide variety of modules.
  • (Optional) JIT (Just In Time) compiled custom DSP code for integrating your own DSP algorithms at runtime. One possible frontend language is the visual “BlockCode” programming language in HexoSynth.
  • Extensible framework for quickly adding new nodes to HexoDSP.
  • A comprehensive automated test suite covering all modules in HexoDSP.

And following DSP nodes:

For a comprehensive list checkout the HexoDSP DSP Node Reference.

CategoryNameFunction
IO UtilOutAudio output (to DAW or Jack)
OscSamplSample player
OscSinSine oscillator
OscBOscBasic bandlimited waveform oscillator (waveforms: Sin, Tri, Saw, Pulse/Square)
OscVOscVector phase shaping oscillator
OscNoiseNoise oscillator
OscFormFMFormant oscillator based on FM synthesis
SignalAmpAmplifier/Attenuator
SignalSFilterSimple collection of filters, useable for synthesis
SignalDelaySingle tap signal delay
SignalPVerbReverb node, based on Dattorros plate reverb algorithm
SignalAllPAll-Pass filter based on internal delay line feedback
SignalCombComb filter
SignalCodeJIT (Just In Time) compiled piece of custom DSP code.
N->MMix33 channel mixer
N->MMux99 channel to 1 output multiplexer/switch
CtrlSMapSimple control signal mapper
CtrlMapControl signal mapper
CtrlCQntControl signal pitch quantizer
CtrlQuantPitch signal quantizer
ModTSeqTracker/pattern sequencer
ModAdAttack-Decay (AD) envelope
ModAdsrAttack-Decay-Sustain-Release (ADSR) envelope
ModTsLFOTri/Saw waveform low frequency oscillator (LFO)
ModRndWkRandom walker, a Sample & Hold noise generator
IO UtilFbWr / FbRdUtility modules for feedback in patches
IO UtilScopeOscilloscope for up to 3 channels
IO UtilMidiPMIDI Pitch/Note input from plugin host, DAW or hardware
IO UtilMidiCCMIDI CC input from plugin host, DAW or hardware
IO UtilExtA - ExtFAccess to plugin parameter sets A to F

API Examples

Documentation

The development documentation with all private fields and functions can be found separately hosted: HexoDSP API Developer Documentation.

High Level SynthConstructor API

HexoDSP offers a high level API for constructing DSP graphs, which is known as the crate::SynthConstructor. In combination with the crate::build module it allows you to define DSP graphs that connect DSP nodes in Rust.

HexoDSP offers you a set of readily available DSP nodes. You can check out the reference documentation of the nodes here: HexoDSP DSP Node Reference.

Additionally you can check out the DynamicNode1x1 DSP node, that allows you define your own DSP nodes to plug into a HexoDSP graph.

Here is a short example that shows how this crate::SynthConstructor API works:

use hexodsp::*;
use hexodsp::build::*;

let mut sc = SynthConstructor::new();

spawn_audio_thread(sc.executor().unwrap());

// Define a sine oscillator at 110Hz. The `0` is used to identify
// the oscillator instance. `sin(1)` would be a second and independent sine oscillator.
// `sin(2)` a third sine oscillator and so on... You may use up to 256 sine oscillators
// if your CPU is fast enough.
let sin = sin(0).set().freq(110.0);

// (Bandlimited) Sawtooth oscillator at 220Hz
let saw = bosc(0).set().wtype(2).set().freq(220.0);

// Setup a mixer node to sum the two oscillators:
let mix = mix3(0).input().ch1(&sin.output().sig());
let mix = mix3(0).input().ch2(&saw.output().sig());

// Turn down the initial output volume of the mixer a bit:
let mix = mix3(0).set().ovol(0.7);

// Plug the mixer into the audio output node:
let out = out(0).input().ch1(&mix.output().sig());

// Upload the DSP graph:
sc.upload(&out).unwrap();

// start some frontend loop here, or some GUI or whatever you like....

// Later at runtime you might want to change the oscillator
// frequency from the frontend:
sc.update_params(&bosc(0).set().freq(440.0));

fn spawn_audio_thread(exec: NodeExecutor) {
    // Some loop here that interfaces with [NodeExecutor::process] and regularily
    // calls [NodeExecutor::process_graph_updates].
    //
    // Please refer to the examples that come with HexoDSP!
}

Hexagonal Matrix API

This is a short overview of the API provided by the hexagonal Matrix API, which is the primary API used inside HexoSynth.

This only showcases the direct generation of audio samples, without any audio device playing it. For a real time application of this library please refer to the examples that come with this library.

use hexodsp::*;

let (node_conf, mut node_exec) = new_node_engine();
let mut matrix = Matrix::new(node_conf, 3, 3);

let sin = NodeId::Sin(0);
let amp = NodeId::Amp(0);
let out = NodeId::Out(0);
matrix.place(0, 0, Cell::empty(sin)
                   .out(None, None, sin.out("sig")));
matrix.place(0, 1, Cell::empty(amp)
                   .input(amp.inp("inp"), None, None)
                   .out(None, None, amp.out("sig")));
matrix.place(0, 2, Cell::empty(out)
                   .input(out.inp("inp"), None, None));
matrix.sync().unwrap();

let gain_p = amp.inp_param("gain").unwrap();
matrix.set_param(gain_p, SAtom::param(0.25));

let (out_l, out_r) = node_exec.test_run(0.11, true, &[]);
// out_l and out_r contain two channels of audio
// samples now.

Simplified Hexagonal Matrix API

There is also a simplified version for easier setup of DSP chains on the hexagonal grid, using the crate::MatrixCellChain abstraction:

use hexodsp::*;

let (node_conf, mut node_exec) = new_node_engine();
let mut matrix = Matrix::new(node_conf, 3, 3);
let mut chain = MatrixCellChain::new(CellDir::B);

chain.node_out("sin", "sig")
    .node_io("amp", "inp", "sig")
    .set_atom("gain", SAtom::param(0.25))
    .node_inp("out", "ch1")
    .place(&mut matrix, 0, 0);
matrix.sync().unwrap();

let (out_l, out_r) = node_exec.test_run(0.11, true, &[]);
// out_l and out_r contain two channels of audio
// samples now.

State of Development

As of 2022-07-30: The architecture and it’s functionality have been mostly feature complete by now. The only part that is still lacking is the collection of modules/nodes, this is the area of current development. Adding lots of nodes.

Make sure to follow Weird Constructors Mastodon account or the releases of this project to be notified of updates.

Running the Jack Example:

To run the example:

    cargo run --release --example jack_demo_node_api

You might need following dependencies (Ubuntu Linux):

    sudo apt install libjack0 libjack-jackd2-dev qjackctl

These might work on Debian too:

    sudo apt install libjack0 libjack-dev

Running the Automated Testsuite:

There exists an automate test suite for the DSP and backend code:

    cargo test

Known Bugs

  • The ones you encounter and create as issues on GitHub.

Credits

  • Dimas Leenman (aka Skythedragon) contributed the FormFM node.

Contributions

I currently have a quite precise vision of what I want to achieve and my goal is to make music with this project eventually.

The projects is still young, and I currently don’t have that much time to devote for project coordination. So please don’t be offended if your issue rots in the GitHub issue tracker, or your pull requests is left dangling around for ages.

If you want to contribute new DSP nodes/modules to HexoDSP/HexoSynth, please look into the guide at the start of the crate::dsp module.

I might merge pull requests if I find the time and think that the contributions are in line with my vision.

Please bear in mind, that I can only accept contributions under the License of this project (GPLv3 or later).

Contact the Author

You can reach me via Discord or Mastodon. I’m joined most public Rust Discord servers, especially the “Rust Audio” Discord server. I am also sometimes on freenode.net, for instance in the #lad channel (nick weirdctr).

Support Development

You can support me (and the development of this project) via Liberapay:

Donate using Liberapay

License

This project is licensed under the GNU General Public License Version 3 or later.

Why GPL?

The obivious reason is that this project copied and translated code from many other free software / open source synthesis projects. The sources will show the origin and license of the individual parts.

My Reasons

Picking a license for my code bothered me for a long time. I read many discussions about this topic. Read the license explanations. And discussed this matter with other developers.

First about why I write code for free at all, the reasons are:

  • It’s my passion to write computer programs. In my free time I can write the code I want, when I want and the way I want. I can freely allocate my time and freely choose the projects I want to work on.
  • To help a friend or member of my family.
  • To solve a problem I have.
  • To learn something new.

Those are the reasons why I write code for free. Now the reasons why I publish the code, when I could as well keep it to myself:

  • So that it may bring value to users and the free software community.
  • Show my work as an artist.
  • To get into contact with other developers.
  • To exchange knowledge and help other developers.
  • And it’s a nice change to put some more polish on my private projects.

Most of those reasons don’t yet justify GPL. The main point of the GPL, as far as I understand: The GPL makes sure the software stays free software until eternity. That the end user of the software always stays in control. That the users have the means to adapt the software to new platforms or use cases. Even if the original authors don’t maintain the software anymore. It ultimately prevents “vendor lock in”. I really dislike vendor lock in, especially as developer. Especially as developer I want and need to stay in control of the computers and software I use.

Another point is, that my work (and the work of any other developer) has a value. If I give away my work without any strings attached, I effectively work for free. This compromises the price I (and potentially other developers) can demand for the skill, workforce and time.

This makes two reasons for me to choose the GPL:

  1. I do not want to support vendor lock in scenarios for free. I want to prevent those when I have a choice, when I invest my private time to bring value to the end users.
  2. I don’t want to low ball my own (and other developer’s) wage and prices by giving away the work I spent my scarce private time on with no strings attached. I do not want companies to be able to use it in closed source projects to drive a vendor lock in scenario.

We can discuss relicensing of my code or project if you are interested in using it in a closed source project. Bear in mind, that I can only relicense the parts of the project I wrote. If the project contains GPL code from other projects and authors, I can’t relicense it.

Re-exports

pub use cell_dir::CellDir;
pub use chain_builder::MatrixCellChain;
pub use dsp::NodeId;
pub use dsp::NodeInfo;
pub use dsp::ParamId;
pub use log::log;
pub use matrix::Cell;
pub use matrix::Matrix;
pub use matrix_repr::load_patch_from_file;
pub use matrix_repr::load_patch_from_mem;
pub use matrix_repr::save_patch_to_file;
pub use matrix_repr::save_patch_to_mem;
pub use nodes::new_node_engine;
pub use sample_lib::SampleLibrary;
pub use sample_lib::SampleLoadError;
pub use scope_handle::ScopeHandle;
pub use synth_constructor::SynthConstructor;
pub use shared_feedback::*;

Modules

Node Reference and Graph Builder for crate::SynthConstructor
Defines an API for easy DSP chain building with the hexagonal crate::Matrix.
HexoDSP DSP nodes and DSP code
global 🔒
Provides an implementation for a shared feedback buffer for the DSP node graph. It is used for instance by the FbWr and FbRd nodes to implement their functionality.
Provides a high level API to the HexoDSP synthesizer engine.
util 🔒
Contains the implementation of the visual DSP programming language named WBlockDSP.

Macros

Structs

A context structure for supporting the DynamicNode1x1::process function.
This struct holds the frontend node configuration.
Holds the complete allocation of nodes and the program. New Nodes or the program is not newly allocated in the audio backend, but it is copied from the input ring buffer. If this turns out to be too slow, we might have to push buffers of the program around.
This structure holds any global state that may be shared among crate::dsp::DspNode instances.

Enums

Traits

This trait allows you to write custom HexoDSP nodes in Rust and provide them at runtime using [crate::NodeConfigurator::set_dynamic_node1x1] or crate::SynthConstructor::set_dynamic_node1x1.

Functions

Type Definitions

Reference to a crate::NodeGlobalData instance.