Tutorials for (New) Music AI Researchers

  • ;-)

Invited keynote by C4DM:deep music generation at Music X Lab.

Invited keynote by Zao Jiu: Music AI and Creativity (In Chinese)

Invited Talk by Bittiger: An overview of computer music in 2 hours (in Chinese)

Deep Music Understanding and Creation @ NYU Shanghai and MBZUAI

  • new

Expressive accompaniment with style transfer.

Style Wheel: HCI + polyphonic chord style transfer

A Music AI Concert: a series of demos of Music AI (from 36')

Computer-aided Multimodal Music Learning @ NYU Shanghai

Haptic guidance 2.0: a better multimodal learning method with scaffolding

Hyper-hybrid Flute: to control pitch bend and octave via breathing on a digital flute.

An overview of our studies on multimodal music learning

Research explorations as a Newkom Fellow @ Dartmouth

  • 2017

Expressive Human-computer music performance with improvisation.

Haptic guidance: a new music tutoring technology

Bio-music computing: use slime mold as a media to analyze and generate music.

Interactive Artificial Performers -- Thesis work @ CMU

  • 2015

Sally Garden performed by the piano robot and myself at Teotronica Inc. in Italy.

Sally Garden performed by the saxophone robot and myself at Waseda University in Japan.

With automated composition.

Learning-based accompaniment: Baseline Vs. my method -- Thesis work @ CMU

  • 2014



My method

Danny Boy



My method

Berceuse from "Dolly" Suite



My method

La Derniere Rose

Note: My method is trained on 4 to 8 rehearsals. Based on the same melody played by a human, the two methods render the collaborative part differently.


Dancing Robot Driven by Music @ CMU and Google

  • 2012

The first try: just synchronized to music beats.

A further development: synchronized to music beats and conveying music emotions.