{"id":77791,"date":"2026-06-18T02:29:15","date_gmt":"2026-06-18T02:29:15","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/77791\/"},"modified":"2026-06-18T02:29:15","modified_gmt":"2026-06-18T02:29:15","slug":"with-latent-terrain-crack-open-ai-and-explore-neural-synthesis-in-max","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/77791\/","title":{"rendered":"With Latent Terrain, crack open AI and explore neural synthesis in Max"},"content":{"rendered":"

\u201cI\u2019m not particularly interested in typing prompts to make stuff, I\u2019m interested in breaking them and dissecting them,\u201d writes Jasper Shuoyang Zheng as he introduces Latent Terrain. Now using an intuitive, elegantly designed open-source Max external and UI, you can play the weird world of neural audio codecs like an instrument, transforming your own sounds into new textures.<\/p>\n

There\u2019s really a lot to say about this general area of activity. Unlike the hyped-up AI in music technologies stealing some headlines, the data source is your own sounds. And the processing is running locally, not in a water-sucking data center. And \u2026 well, it\u2019s just beautiful and weird, and you can play using instrumental techniques.<\/p>\n

Naturally, that is attracting musicians and experimenters, because it brings neural nets back to discovering new sounds instead of making everything sound the same.<\/p>\n

\"\"<\/a><\/p>\n

Latent Terrain is a beautiful place to start \u2014 not least because it\u2019ll be accessible to Max users, especially those already working with FluCoMa or Data Knot. It produces a visual map, a kind of warped texture, which you can move through however you like, from a mouse to a controller. You can even train your own small neural network directly in Max, and watch timbres shatter, fracture, and meld into new materials. You can carefully construct sound libraries and chart paths through them; it\u2019s deeply personal.<\/p>\n

Here\u2019s a great example by Keigo Yoshida, just to get a sense of the sound \u2014 this one using the tech to sonify EEG readings.<\/p>\n

There are also more than just demos, but artistic demos that push the technology as a way to unravel sonic meaning. I love Jiatong Liu\u2019s work here, not least because my first impression of Beijing was being struck by the Hutongs, really wanting to walk forever through them.<\/p>\n

Would love to hear more, Jasper, so consider this a first look! (The project will also be at NIME \u2013 The International Conference on New Interfaces for Musical Expression<\/a> \u2013 in London later this month.)<\/p>\n

Jiatong Liu\u2018s nn\/m\u00e9moire is a virtual gallery soundscape built from archival recordings of Beijing\u2019s Hutong neighbourhoods \u2014 a rapidly disappearing urban soundworld. The terrain becomes an ambient archive you move through spatially. Liu described \u201clearning to deal with the unpredictability\u201d as a central design question, not a problem to eliminate.<\/p>\n

\"\"<\/a><\/p>\n

It\u2019s also all exquisitely well documented, so dive in. There\u2019s this article by Jasper, which is a good guide through the work and its possibilities:<\/p>\n

Latent Terrain: Dissecting Neural Audio Codecs<\/a><\/p>\n

And a project page, including the research:<\/p>\n

https:\/\/jasper-zheng.github.io\/nn_terrain\/<\/a><\/p>\n

Example Max for Live devices are inbound, and you can use different audio autoencoders for different results, with a few popular choices already supported. There\u2019s been a bunch of action on the Stable Audio front, too, more generally, so I\u2019ll try to catch up. <\/p>\n

Download for Max (and Max for Live), on macOS and Windows. (And yeah, I\u2019m sure someone is thinking about Pure Data, so stay tuned\u2026)<\/p>\n

https:\/\/jasper-zheng.github.io\/nn_terrain\/installation<\/a><\/p>\n

Previously, and very relevant:<\/p>\n

\t Tags: AI<\/a>, autoencoders<\/a>, externals<\/a>, FLOSS<\/a>, free as in freedom<\/a>, Jasper Shuoyang Zheng<\/a>, latent space<\/a>, latent terrain<\/a>, Mac<\/a>, machine learning<\/a>, MacOS<\/a>, max<\/a>, max for live<\/a>, neural audio<\/a>, neural audio codecs<\/a>, neural nets<\/a>, nime<\/a>, open source<\/a>, research<\/a>, Software<\/a>, sound art<\/a>, synthesis<\/a>, Windows<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"\u201cI\u2019m not particularly interested in typing prompts to make stuff, I\u2019m interested in breaking them and dissecting them,\u201d…\n","protected":false},"author":2,"featured_media":77792,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[24,42476,42477,42478,42479,42480,6619,42481,16244,50,8345,42482,42483,42484,42485,42486,42487,335,157,52,136,42488,42489,3246],"class_list":["post-77791","post","type-post","status-publish","format-standard","has-post-thumbnail","category-openai","tag-ai","tag-autoencoders","tag-externals","tag-floss","tag-free-as-in-freedom","tag-jasper-shuoyang-zheng","tag-latent-space","tag-latent-terrain","tag-mac","tag-machine-learning","tag-macos","tag-max","tag-max-for-live","tag-neural-audio","tag-neural-audio-codecs","tag-neural-nets","tag-nime","tag-open-source","tag-openai","tag-research","tag-software","tag-sound-art","tag-synthesis","tag-windows"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/77791","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=77791"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/77791\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/77792"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=77791"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=77791"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=77791"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}