Moth VJ - Tools for making basic sound visualizations

For a end of the year kinda fun project, i want to make some kind of script or something that takes in

INPUT

  • Insect Imagery Photos (PNGs with transparent backgrounds of the critters we detect)
  • Insect Data (CSV includes time it was spotted, ID)
  • Audio

OUTPUT

  • Some Fun weird animated visualizations that react to the audio being put in

My first instinct would be to try to code something up in python or processing, but i realized there’s probably been better advances in VJ-ing tools since i was doing more stuff like that.

Is there something better or quick and easy i can get started working in?

Ideally if someone knew some very specific python or processing library or plugin i would love that as i have the most experience.

but like if i asked instagram it would prob be like use TOUCHDESIGNER (but i don’t feel like they are the most open in ways i like)
or other folks might say do something cool in BLENDER - but that seems like a huge rabbit hole unless someone knows some VERY specific plugins or workflows to do cool stuff like that.

I have never used VVVV

live coding might be good

Hydra works in browser for example this:

https://hydra.ojack.xyz/api/#functions/initImage/0

can pull in pictures from url / github for the image

SonicPi could be used with Audio / + some csv data
as could Strudel (example) Finance Song
https://strudel.cc/#LyogbWFuIGluIGZpbmFuY2UgQGJ5IHYxMDEwMWEgCisgImRhcyBpc3QgYmFzcyIgQGJ5IGVuZWxnLGZyb29zCiovCgpzYW1wbGVzKHsKICBmaW5hbmNlOiAgWydtYW4taW4tZmluYW5jZS9maW5hbmNlXzAwLndhdicsICdtYW4taW4tZmluYW5jZS9maW5hbmNlXzAxLndhdicsICdtYW4taW4tZmluYW5jZS9maW5hbmNlXzAyLndhdicsICdtYW4taW4tZmluYW5jZS9tdXJyYXloaWxsLndhdiddCn0sICdnaXRodWI6c2FuZHBpbGxzL3YxMDEwMWEtc2FtcGxlcy9tYWluLycpOwoKCiQ6IG4oIjwxIDA%2BIikucygiZmluYW5jZSIpLnNsb3coMikuY2xpcCgxKQogIC5tYXNrKCI8MSAxIDEgMD4vNCIpCgokOiBuKCIwIikucygiZmluYW5jZSIpLnNsb3coMikuY2xpcCgxLjQpCiAgLnN0cnVjdCgiMSg8MyA1Piw4KSIpCiAgLm1hc2soIjwwIDAgMCAxPi80IikuZ2FpbigwLjgpLnJvb20oMS4yKQoKJDogbm90ZSgiPGExIGMyPi8yIikKLnNvdW5kKCJzdXBlcnNhdyIpCi5ldWNsaWRMZWdhdG8oOSwxNikKLmZ0eXBlKCcyNGRiJykKLmxwZih0cmkucmFuZ2V4KDIwMDAsNDAwKS5zbG93KDgpKQoubHBlbnYoNikKLmRpc3QoIjI6LjQiKQouZWNobygyLCAxLzE2LCAuNykKLm11bChnYWluKCJbLjUgMSEzXSo0IikpIC8vc2lkZSBjaGFpbgouYWRkKG5vdGUoIjxbMCA1XSo0IFs1IDEwXSo0PiIpKQovLyAuaHVzaCgpCgokOiBzKCJvaCoxNiIpCiAgLmJhbmsoIlJvbGFuZFRSOTA5IikKICAuZGVjYXkoc2luZS5yYW5nZSguMiwuNCkpCiAgLmRpc3QoIjE6LjMiKQogIC5tdWwoZ2FpbigiWzwwITMgMT4gLjIgMSA8MCEzIC4yPl0qNCIpKSAvL2dyb292ZQogIC5tdWwoZ2FpbigiWy4yIDEhM10qNCIpKSAvL3NpZGUgY2hhaW4KICAucGFuKHRyaS5yYW5nZSguNywuMykpCiAgLmhwZig4MDApCiAgLnJvb20oLjEpCiAgLm1hc2soIjwwIDE%2BLzgiKQogIC8vIC5odXNoKCkKCiQ6IHMoImJkKjQiKS5iYW5rKCdSb2xhbmRUUjkwOScpLmRpc3QoIjE6MSIpCgouc2NvcGUoKQ%3D%3D

1 Like

Cool! Ill check em out!

I’ve also been looking at librosa
https://librosa.org/doc/latest/tutorial.html