Work in Progress Last Updated: 25-05-2022 by Uriel Deveaud (AKTIV25)

This current documentation (in progress) is intended to demonstrate the requested audio features in the context of editing audio contents/data within Blender¹ itself, the well known Free and Open Source 3D application, and within Audaspace², the Audio C++ Library built in Blender to process digital audio. It is mainly used in the Video Sequencer Editor (VSE) for playing Audio strips and 3D Space as 3D Speaker Objects.

Here, i want to present specific features which will make it possible to work on the audio data, including routing, processing and visualizations. For all users with basic needs in terms of Audio Mixing, this proposal is focused on:

• Media Productivity³, including audio and Video editing, Animations, Games Post-production...
• VR/AR Art and Experiments, including Multiverse Production, Installations and Real-time Performances
• Surround Contents Creation, including music clip edition and digital mixing console, up to 8 outputs channels

The main goal is to build a new patch (or maybe a Git Branch) to present to the Blender Foundation⁴ and GSoC 2023⁵. The development of this patch is encouraged by the Blender community members and it will be first tested by other Blender developpers, then it will be sent to the BF for final approval. I invite you to post in the "Pull Requests" section any comments or suggestions that you think it is important to consider. Thank you.

• Main Development Research References: Concepts, Strategy, GUI,
• Additional Research: Spatial Audio and Matrix Routing
• Personal documentation: Blender and Audaspace related specifications.
• Features Development: Visualization Tools and Operators and Properties
• GSoc 2023 Presentation (Video, 3D Avatar, Surround Audio)

• 1️⃣ New General Audio Features & System Preferences
  • Channels Options, Custom Channels, Channels Outputs Configuration, Gui Implementation
  • Classes, Properties, Operators, Device, Device_channels, Device_output_Name
  • Sources, Notes, List

• 2️⃣ New Sequencer Sound Strip Properties
  • Mixer Properties, Sound_Strip Output Bus Assign, Device Main Mixer, Sound Modifiers, Preview
  • Classes, Properties, Operators, Device, Device_channels, Device_output_Name
  • Sources

• 3️⃣ New Sound Mixer Space Features
  • Sound Mixer Space, Audio Signals, Audio Nodes, Animate, FX Processing
  • Sources

Opt

• 4️⃣ New Sound Clip Editor Features (Optional)
  • Clip Editor, Markers, Fades, Export, FX Processing
  • Sources

This document is not a definitive version yet! I do add, remove and update many parts, "without announcement", to re-format the complete documentation. Stay tuned!

• Blender Source Code: Repository / Code Structure / Developpers Documentation / Advices
• Building Blender Windows OS / Coding Style / Patching / Diferencial / Arcanist

• Audaspace Library 1.3.0 Official documentation, and neXyon´s repository
• Audaspace in Blender Python API 3.1x / Sound Operators / Sound Sequences (Strip)
• Audio Nodes by neXyon / by noemlif

• VSE Addons: Audio Strip Fade / Text to Speech / VSE customizations / Sequencer Audio Recording / Dolby Atmos Exporter / Channels Export / Cut on Peak
• Talks: VSE Sound Clip (RightClicSelect) / Proposal VSE Nodes
• External Tools Addons: Blender Audacity

2022 May - Basic Audio Preferences rewriting, Vu-meter Class, Tasks list

2022 Abril - First Dev Planning and ideas, Files and contents structure

2017 Abril - First Vst Plugin Development, Samples Players, Filters in C++

2016 March - First Sequencer Script/Addon Development, Strips Management

2014 February - First Midi Script/Addon Development, Learning RTmidi C++ Lib

2012 March - First Movie Making workshop,teaching using the Blender VSE (82 students)

2011 January - First Professional Blender Training, Design and Architecture (113 students)

2010 January - First Audio Script/Addon Development, Learning Audaspace C++ Lib

2009 October - First 3D Animation School Program, (185 students)

2008 October - First Professional Video Editing using Blender VSE

2007 September - First Blender Python Script Development

2005 June - First Professional Animation Production using Blender

2002 December - First 3D Model Production using Blender Free Software

2001 September - First Audio/Midi Hardware Development⁶

• Author: Uriel Deveaud⁷ - Kore Teknology