GrepAwk · Palo Alto, CA
Building browser-native and on-device tools for audio, video, and music. Focused on WebAssembly, Core ML, low-level DSP, and zero-copy pipelines.
- Audio / DSP / MIDI — Web Audio API, SoundFont engines, parametric EQ, FFT, wavetable synthesis, AudioWorklets
- Video — FFmpeg + WASM video editing; maintained multithreaded ffmpeg.wasm fork (FFmpeg 8.0.1 on Emscripten 4)
- On-device iOS ML — Core ML + AVFoundation for optical music recognition (OMR), polyphonic pitch detection → engraved sheet music, and camera settings optimization
- Low-level systems — C, Swift, Rust, WebAssembly, GPU/NN acceleration, lock-free designs
| Project | Description | Language |
|---|---|---|
| finalcut | FFmpeg + Grok powered video editor → grepawk.com | JavaScript |
| omr-sheet-cam | On-device OMR with zero-copy ORT, parallel staffs, SMF MIDI + highlights | Swift |
| earsheet | Polyphonic pitch → engraved sheet music (Core ML / fine-tuned Basic Pitch) | C |
| photo-recipes | Core ML + AVFoundation camera settings optimizer | Swift |
| sf2rend | MIDI / SoundFont player | JavaScript |
| ffmpeg.wasm | Maintained multithreaded FFmpeg WASM fork | C |
- Browser Minecraft-style voxel engine (mc4)
- Parametric EQ / DSP mixer (grepaudio)
- Experiments and demos: pages · yishengjiang99.github.io
Open to collaboration on audio, video, WASM, and on-device ML.