P3D

P3D is an unfinished project I worked on between 2016 and 2018 with Laurent Harduin. It is about exploring a procedural island full of plants and animals interacting with each other and with the player. One of the goals was to have all audio and visual assets procedurally synthesised in real-time.

Some of the work I did includes:

real-time audio synthesis using Pure Data, Heavy, and Wwise. I don’t have any capture of these sounds, but some of them ended up being used for later projects, like Bird Ladies.
procedural organic-looking placement of fauna elements on the terrain
ray tracing-based environment scanning system for detecting water bodies and fauna around the listener and placing sounds accordingly
wind map to drive audio and visuals at any point of the game world with the same data
behaviours of a few animals, including rabbits and flocks of birds
complementary colour system used to colourise fauna, the terrain, the sky, and the sun. Although, if I remember correctly, this feature was redone completely (and better) by Laurent when we switched from Unreal Engine to Unity.

Some of the animals we started working on were birds flying around in large flocks. It was interesting to work on these tornado-like flying patterns.
Every single bird is represented as a cuboid as a placeholder. The plan was to create some procedural meshes and to animate them later on.

Before we had any proper visuals for the rabbits, I worked on their behaviours with placeholder cubes. Jumping around and getting close to each other, growing, dying if they fall in the water, dying of old age, making babies, etc.
Here, only the jumping and the growing mechanics are shown. For the purpose of the demonstration, they grow very fast. Unlucky rabbits sometimes make mistakes and fall from the island into the water.

This is the prototype of a system that generates wind values all over the terrain for the plants to use and react to it (by bending, rustling, or shaking). We wanted to make sure audio and visuals react at the same time at any given point in space.
On the video, you can see the wavefront of the wind going from left to right and the wind intensity changing over time.