Category: Voice Analysis

Machine Learning . Voice Analysis

[๋ฒˆ์—ญ] Baidu Deep Voice: Part 2 โ€“ ํ•™์Šต (Training)

On April 9, 2019 by

Deep Voice ํŒŒํŠธ 1 ๋งํฌ ์ด ๊ธ€์€ ์ €์ž(Dhruv Parthasarathy)์˜ ํ—ˆ๋ฝ์„ ๋ฐ›์•„ ๋ฒˆ์—ญํ•˜์—ฌ ๊ฒŒ์‹œํ•˜๋Š” ๊ธ€์ž…๋‹ˆ๋‹ค. ์›๋ฌธ์€ https://blog.athelas.com/baidu-deep-voice-explained-part-2-training-810e87d20047์—์„œ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์›์ž‘์ž๋ฅผ ‘๋‚˜‘๋กœ ํ‘œ๊ธฐํ•˜์˜€์Šต๋‹ˆ๋‹ค, ‘์ตœ๊ทผ‘์ด๋ผ๋Š” ๋‹จ์–ด๋Š” 2017๋…„ 3๋…„์„ ๊ธฐ์ค€์ด๋ฏ€๋กœ ์ง€๊ธˆ(2019๋…„)๊ณผ์˜ ์ฐจ์ด๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ์Œ์„ ๋ฏธ๋ฆฌ ๋ฐํž™๋‹ˆ๋‹ค. Arxiv ๋งํฌ: https://arxiv.org/abs/1702.07825 ๊ธฐ๊ด€: Baidu Research Baidu์˜ TTS ์‹œ์Šคํ…œ์— ๋”ฅ๋Ÿฌ๋‹์„ ์ ์šฉ์‹œ์ผฐ๋˜ Deep Voice์— ๋Œ€ํ•œ ๋‘๋ฒˆ์งธ ํฌ์ŠคํŒ…์ด๋‹ค. ์ด ํฌ์ŠคํŒ…์—์„œ ์šฐ๋ฆฌ๋Š”, ๋ ˆ์ด๋ธ”๋งํ•œ ๋ฐ์ดํ„ฐ๋ฅผ Read More

Machine Learning . Voice Analysis

[๋ฒˆ์—ญ] Baidu Deep Voice: Part 1 – Text-to-speech ํŒŒ์ดํ”„๋ผ์ธ(The Inference Pipeline)

On March 27, 2019 by

๋“ค์–ด๊ฐ€๋ฉฐ ์ด ๊ธ€์€ 2017๋…„ 3์›”์— ์ž‘์„ฑ๋œ ๋‚ด์šฉ์œผ๋กœ, ๋”ฅ๋Ÿฌ๋‹ ๋ชจ๋ธ, ์•Œ๊ณ ๋ฆฌ์ฆ˜์˜ ๋ฐœ์ „ ์†๋„๋ฅผ ์ƒ๊ฐํ•ด๋ณด๋ฉด 2๋…„๊ฐ„์˜ ์ฐจ์ด๋Š” ์ƒ๋‹นํžˆ ํฌ๋‹ค๊ณ  ๋ณผ ์ˆ˜ ์žˆ๋‹ค. ๊ทธ๋Ÿฌ๋‚˜ ๊ฐœ์ธ์ ์œผ๋กœ ์Œ์„ฑ์— ๋Œ€ํ•œ ๋”ฅ๋Ÿฌ๋‹ ์—ฐ๊ตฌ๋Š” ์ด๋ฏธ์ง€ ์ฒ˜๋ฆฌ์— ๋น„ํ•ด ์ž˜ ์™€๋‹ฟ์ง€ ์•Š์•„, Mask R-CNN์˜ ๋ฒˆ์—ญ์ฒ˜๋Ÿผ, ๊ทธ ๊ธฐ์ดˆ๋ฅผ ๋‹ค์ง€๋Š”๋ฐ ๋„์›€์ด ๋˜์ง€ ์•Š์„๊นŒํ•˜์—ฌ ๋ฒˆ์—ญ์„ ์‹œ์ž‘ํ•ด๋ณธ๋‹ค. (2019๋…„ 3์›” 24์ผ) ์ด ๊ธ€์€ ์ €์ž(Dhruv Parthasarathy)์˜ ํ—ˆ๋ฝ์„ ๋ฐ›์•„ ๋ฒˆ์—ญํ•˜์—ฌ ๊ฒŒ์‹œํ•˜๋Š” ๊ธ€์ž…๋‹ˆ๋‹ค. Read More

Voice Analysis

์ผ์ƒ์—์„œ์˜ ์Œ์› ๋ ˆ๋ฒจ

On July 28, 2017 by

์›์ถœ์ฒ˜ : Durrant & Lovrinic (1995) ์ถœ์ฒ˜ : ์–ธ์–ด์ž„์ƒ์„ ์œ„ํ•œ ์Œ์„ฑ๊ณผํ•™ 2ํŒ, ์‹œ๊ทธ๋งˆํ”„๋ ˆ์Šค ์Œ์Œ๋ ˆ๋ฒจ(dB SPL ๋˜๋Š” IL)๊ฐ€์ฒญ์—ญ์น˜0์ •์ƒ์ ์ธ ํ˜ธํก10๋‚˜๋ญ‡์žŽ์ด ์›€์ง์ด๋Š” ์†Œ๋ฆฌ20๋งค์šฐ ์กฐ์šฉํ•œ ์†์‚ญ์ž„30์กฐ์šฉํ•œ ๊ฑฐ์ฃผ์ง€์—ญ์—์„œ์˜ ๋Œ€ํ™”40๋ฐฑํ™”์ 50์ผ๋ฐ˜์ ์ธ ๋Œ€ํ™”60์ด๋™ํ•˜๋Š” ์ฐจ์˜ ๋‚ด๋ถ€70๋ผ๋””์˜ค์˜ ์‹œ๋„๋Ÿฌ์šด ์Œ์•…80๋„์‹œ์˜ ๊ตํ†ต90์ง€ํ•˜์ฒ 100ํฐ ์ฒœ๋‘ฅ์†Œ๋ฆฌ110ํฐ ์†Œ๋ฆฌ์˜ ๋กœํฐ๋กค ๋ฐด๋“œ120๊ทผ๊ฑฐ๋ฆฌ์—์„œ์˜ ๊ธฐ๊ด€์ด ๋ฐœํฌ130์ด๋ฅ™ํ•  ๋•Œ์˜ ์ œํŠธ์—”์ง„140๋กœ์ผ“ ๋ฐœ์‚ฌ180 Read More

Voice Analysis

Applied speech and audio processing – ์ •๋ฆฌ

On July 19, 2017 by

์ •๋ฆฌ์ค‘ Read More

Voice Analysis

Pre-emphasis filtering, Ceptral mean normalization

On July 19, 2017 by

๋‹ค์Œ๊ณผ ๊ฐ™์€ ํ•„ํ„ฐ๋ง ๊ณต์‹์„ ํ†ตํ•ด ์ €์ฃผํŒŒ์ˆ˜์˜ amplitude๋Š” ์ค„์ด๊ณ , ๊ณ ์ฃผํŒŒ์ˆ˜๋Š” ์ฆ๊ฐ€์‹œํ‚ค๋Š” ๋ฐฉ์‹์„ ์ด์šฉํ•œ๋‹ค. Applied Speech and Audio Processingย  ์ฑ…์˜ 102p์— ๋‹ค์Œ๊ณผ ๊ฐ™์ด ๋‚˜์™€์žˆ๋‹ค.(๋ฒˆ์—ญ์€ ๋‚ด๋ง˜๋Œ€๋กœ) LPC ๋ถ„์„์€ high frequency๋Š” poorํ•œ ๋ฐ˜๋ฉด์—, lower frequencys๋ฅผ ๋” ์ •ํ™•ํžˆ ๋งž์ถ”๋Š”(?;satify) ๊ฒฝํ–ฅ์ด ์žˆ๋‹ค. ใ…‡๊ทธ๋ž˜์„œ LPC ๋ถ„์„ ์ „์— pre-emphasis๋ฅผ ์‹œํ‚ค๋Š” ๊ฒƒ์ด ์ผ๋ฐ˜์ ์ด๋‹ค. ์Œ์„ฑ์ด ์ž…์„ ํ†ตํ•ด ๋ฐœํ™”๋  ๋•Œ, ๋†’์€ ์••๋ ฅ์—์„œ ๋Œ€๊ธฐ๋ผ๋Š” ๋‚ฎ์€ ์••๋ ฅ์œผ๋กœ ๋‚˜์˜ค๋ฉด์„œ, Read More

Voice Analysis

์Œ์„ฑ ์Œํ–ฅ ๋ถ„์„๋ก  – ์ •๋ฆฌ

On July 18, 2017 by

์ฑ…: ์Œ์„ฑ ์Œํ–ฅ ๋ถ„์„๋ก , ์ œ2ํŒ, ๋ฐ•ํ•™์‚ฌ [1] ๋ถ„์„ ๋ชฉ์ ์œผ๋กœ ์ด์šฉ๋˜๋Š” ์ตœ์†Œ ์‹œ๊ฐ„ ๋ถ„ํ•ด๋Œ€๋Š” ์•ฝ 10ms, ์ž์Œ์˜ ๊ฐœ๋ฐฉ(release)์™€ ๊ด€๋ จ๋œ ์ˆœ๊ฐ„์Œ ํŒŒ์—ด(transient burst)์™€ ๊ฐ™์€ ์ค‘์š”ํ•œ ์Œ์„ฑ๊ฒฐ๊ณผ์— ๋Œ€ํ•œ ๊ฐ€์žฅ ์งง์€ ๊ตฌ๊ฐ„์ด๋‹ค.(pat, cat, tat ๋“ฑ์˜ ์ฒซ ์Œ๋“ค) ์Œ์„ฑ ์‹ ํ˜ธ์˜ ๋Œ€๋ถ€๋ถ„์€ 10kHz์˜ ๋ฒ”์ฃผ์— ๋ถ„ํฌํ•˜๋ฉฐ 60dB ์ •๋„์˜ dynamic range, 10ms๋‚˜ ํ˜น์€ ๊ทธ ์ดํ•˜์˜ ์ค‘์š”ํ•œ ๋ณ€ํ™”๋ฅผ ๋‹ด๊ณ  ์žˆ๋‹ค.(16p) [2] ๋น„์Œ์€ ๋ชจ์Œ์ฒ˜๋Ÿผ ์ „ํ˜•์ ์œผ๋กœ Read More

Voice Analysis

์ˆ˜ํ•™์œผ๋กœ ๋ฐฐ์šฐ๋Š” ํŒŒ๋™์˜ ๋ฒ•์น™ – ์ •๋ฆฌ

On July 13, 2017 by

[1] ํฐ ๋ชฉ์†Œ๋ฆฌ – ํŒŒ๋™์ด ๋†’๋‹ค. – ์ง„ํญ์ด ํฌ๋‹ค. ์ž‘์€ ๋ชฉ์†Œ๋ฆฌ – ํŒŒ๋™์ด ๋‚ฎ๋‹ค. – ์ง„ํญ์ด ์ž‘๋‹ค. ๋†’์€ ๋ชฉ์†Œ๋ฆฌ – ํŒŒ๋™์˜ ํญ์ด ์ข๋‹ค – ์ง„๋™์ˆ˜(์ฃผํŒŒ์ˆ˜;Hz)๊ฐ€ ๋†’๋‹ค – ์งง์€ ์ฃผ๊ธฐ(T) ๋‚ฎ์€ ๋ชฉ์†Œ๋ฆฌ – ํŒŒ๋™์˜ ํญ์ด ๋„“๋‹ค – ์ง„๋™์ˆ˜(์ฃผํŒŒ์ˆ˜)๊ฐ€ ๋‚ฎ๋‹ค – ๊ธด ์ฃผ๊ธฐ [2] ์‚ฌ๋žŒ์˜ ๋“ฃ๋Š” ์ฃผํŒŒ์ˆ˜ 20Hz~20000Hz ์ •๋„๊นŒ์ง€ ๋“ค๋ฆฐ๋‹ค? (50p) [3] ๊ธฐ๋ณธ์ฃผํŒŒ์ˆ˜ – ๊ฐ๊ฐ์˜ ์ง„๋™์ˆ˜๋ฅผ ๊ฐ–๋Š” Read More

Voice Analysis

ํ‘ธ๋ฆฌ์— ํ•ด์„ – ๊ธฐ์ดˆ ๊ณต๋ถ€

On July 11, 2017 by

์ฐธ๊ณ ์„œ์  : ๋งŒํ™”๋กœ ํ•จ๊ป˜ ๋ฐฐ์šฐ๋Š” ํ‘ธ๋ฆฌ์— ํ•ด์„, ์„ฑ์ธ๋‹น <๊ธฐ์ดˆ์ง€์‹ 1> ์ง„๋™์„ ์›์œผ๋กœ ํ‘œํ˜„ํ•˜๋ฉด, ์œ„์˜ ๊ทธ๋ฆผ๊ณผ ๊ฐ™์ด ๋‚˜ํƒ€๋‚ผ ์ˆ˜ ์žˆ๋‹ค. ์œ„์˜ , ๋ฅผ ๋”ฐ๋กœ ๋‚˜ํƒ€๋‚ด๋ณด๋ฉด ์™€ ์˜ ๊ด€๊ณ„๋Š” ์œ„์˜ ๊ทธ๋ฆผ์ฒ˜๋Ÿผ ๋‚˜ํƒ€๋‚ผ ์ˆ˜ ์žˆ๊ณ , ์™€ ์˜ ๊ด€๊ณ„๋Š” ์•„๋ž˜์™€ ๊ฐ™๋‹ค. <๊ธฐ์ดˆ์ง€์‹ 2>     ์‚ผ๊ฐํ•จ์ˆ˜์˜ ๋ฏธ๋ถ„์€ ๋ฅผ ๊ณผ์žฅํ•˜์—ฌ ํ™•๋Œ€ํ–ˆ์„๋•Œ ๊ทธ๋ ค์ง€๋Š” ์‚ผ๊ฐํ˜•์„ ์ด์šฉํ•ด์„œ ๊ตฌํ•˜๋ฉด ๋œ๋‹ค. ๋ฐ˜์ง€๋ฆ„ 1์˜ ์›์„ ๊ธฐ์ค€์œผ๋กœ Read More

Voice Analysis

[Android] AudioRecorder๋กœ Lame์„ ์ด์šฉํ•œ MP3 ๋…น์Œํ•˜๊ธฐ

On April 23, 2014 by

์•ˆ๋“œ๋กœ์ด๋“œ์—์„œ MediaRecorder๋ฅผ ์ด์šฉํ•ด ๋…น์Œํ•˜๋Š” ๊ฒƒ์€ ์‰ฝ์ง€๋งŒ, ์กฐ๊ธˆ ๋” ์‹ฌ๋„์žˆ๋Š”(?) ๋…น์Œ์„ ์œ„ํ•ด์„œ๋Š” AudioRecorder ํด๋ž˜์Šค๋ฅผ ์ด์šฉํ•ด์•ผํ•œ๋‹ค. AudioRecorder๋กœ MP3๋ฅผ ๋…น์Œํ•˜๋Š” ๋ฐฉ๋ฒ•์€ WAV๋ฅผ ๋…น์Œํ•˜๋Š” ๋ฐฉ๋ฒ•๊ณผ ํฌ๊ฒŒ ๋‹ค๋ฅด์ง€ ์•Š๋‹ค. – ๊ธฐํšŒ๊ฐ€ ๋˜๋ฉด WAV๋„ ํฌ์ŠคํŒ…ํ•˜๊ธฐ๋กœ ํ•˜๊ณ .     ์ผ๋‹จ MP3๋…น์Œ์„ ์œ„ํ•ด ์™ธ๋ถ€ library๋ฅผ importํ•œ๋‹ค. ์ผ๋ณธ์ธ์ด ๋งŒ๋“  ๋“ฏํ•œ SimpleLameLibForAndroid๋ผ๋Š” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๊ฐ€ ์ž˜ ์“ฐ์ด๋Š” ๋“ฏ ํ•˜๋ฉฐ ๊ตฌ๊ธ€์— ๋งŽ์€ ์˜ˆ์ œ๊ฐ€ ์žˆ์œผ๋‚˜ ๋ญ”๊ฐ€ ๋ณต์žกํ•œ ๋“ฏ. ์ด๋ฅผ Read More

โœ๏ธ Monolog . Voice Analysis

Recent work

On April 5, 2014 by

์ตœ๊ทผ์— ์ž‘์—… ์ค‘์ธ Project๋Š” ์ด 2๊ฐœ, ์•ฝ๊ฐ„ ํ‘œ๋ฅ˜ํ•˜๊ณ  ์žˆ๋Š” Project 2๊ฐœ. (1) VoiceLab (by MATLAB): ๊ทธ ๋™์•ˆ์˜ ์‚ฝ์งˆ์ด ์Šฌ์Šฌ ๊ฒฐ์‹ค์„ ๋ณด๊ณ  ์žˆ๋‹ค. formant, pitch(F0), LPC ๋“ฑ๋“ฑ์— ๋Œ€ํ•œ ์ด๋ก ๋“ค๋„ ๋งŽ์ด ์Šต๋“ํ–ˆ๊ณ , ์กฐ๋งŒ๊ฐ„ ์ด์ชฝ์— ๋Œ€ํ•œ ํฌ์ŠคํŒ…์„ ์ง„ํ–‰ํ•ด๋ณด๋ ค๊ณ  ๊ณ„ํš ์ค‘ (2) ???? (by Android): ์Šน์šฐ์˜ ๋„์›€์œผ๋กœ ์ง„ํ–‰์— ๊ฐ€์†๋„๋ฅผ ๋ถ™์ด๋Š” ์ค‘. ๊ฑฐ์˜ ๋ฐ๋ชจ ๊ฐœ๋ฐœ์€ ์™„๋ฃŒํ–ˆ๊ณ , ์กฐ๋งŒ๊ฐ„ ์ž„์ƒ์— ์ ์šฉํ•ด์„œ validation Read More

1 2