Skip to content

Latest commit

ย 

History

History
53 lines (36 loc) ยท 3.73 KB

File metadata and controls

53 lines (36 loc) ยท 3.73 KB

๐Ÿ›  Tech Stack

๐Ÿ–ฅ Frontend: Kiosk Application

Category Technology
Kiosk Controller
Raspberry Pi
Voice AI
Porcupine
Rhino
IoT Communication
Mosquitto
Frontend Framework
React
UI Framework
MUI
Programming Language
JavaScript
Styling
Emotion

๐Ÿงฉ ํ”„๋กœ์ ํŠธ ๊ฐœ์š”

Barion: ์Šค๋งˆํŠธ ๋ฐฐ๋ฆฌ์–ดํ”„๋ฆฌ ํ‚ค์˜ค์Šคํฌ ํ”Œ๋žซํผ์—์„œ ๋ผ์ฆˆ๋ฒ ๋ฆฌํŒŒ์ด(Raspberry Pi) ๋Š” ๋‹จ์ˆœํžˆ React ๊ธฐ๋ฐ˜ Kiosk UI ์ถœ๋ ฅ ์žฅ์น˜๋ฅผ ๋„˜์–ด์„œ, ์ „์ฒด ํ‚ค์˜ค์Šคํฌ ์‹œ์Šคํ…œ์„ ์ œ์–ดํ•˜๊ณ , ๋‹ค์–‘ํ•œ ํ•˜๋“œ์›จ์–ด ๋ฐ AI ๊ธฐ๋Šฅ์„ ํ†ตํ•ฉํ•˜๋Š” ์ค‘์•™ ์ œ์–ด ์žฅ์น˜ ์—ญํ• ์„ ์ˆ˜ํ–‰ํ•œ๋‹ค.


๐Ÿ“Œ ๋ผ์ฆˆ๋ฒ ๋ฆฌํŒŒ์ด์˜ ์—ญํ• 

1. ํ‚ค์˜ค์Šคํฌ UI ์‹คํ–‰

  • ํฌ๋กœ๋ฏธ์›€ ๋ธŒ๋ผ์šฐ์ €๋ฅผ ์ด์šฉํ•˜์—ฌ React ๊ธฐ๋ฐ˜์˜ ํ‚ค์˜ค์Šคํฌ ์•ฑ์„ ํ‚ค์˜ค์Šคํฌ ๋ชจ๋“œ๋กœ ๊ตฌ๋™
  • React ์•ฑ์€ ์‚ฌ์šฉ์ž์™€์˜ ์ธํ„ฐ๋ž™์…˜(์Œ์„ฑ ๋ช…๋ น, ์ฃผ๋ฌธ ๋“ฑ)์„ ๋‹ด๋‹น
  • React์•ฑ ๋‚ด์— Picovoice ๊ธฐ๋ฐ˜ On-Device Voice Ai ์Œ์„ฑ ์ฃผ๋ฌธ ์‹œ์Šคํ…œ ๋„์ž…: Wake word ๋ฐ Speech-to-Intent ์—”์ง„ ์—ฐ๋™

2. ์Œ์„ฑ ์ž…์ถœ๋ ฅ ๋””๋ฐ”์ด์Šค ์ œ์–ด

  • USB ๋งˆ์ดํฌ ๋ฐ ๋ธ”๋ฃจํˆฌ์Šค ์Šคํ”ผ์ปค ์—ฐ๋™์„ ํ†ตํ•ด ์‚ฌ์šฉ์ž ์Œ์„ฑ ์ธ์‹๊ณผ ์•ˆ๋‚ด ์Œ์„ฑ ์ถœ๋ ฅ

3. MQTT ๊ธฐ๋ฐ˜ ๋ฉ”์‹œ์ง€ ๋ธŒ๋กœ์ปค ์—ญํ• 

  • MQTTํ†ต์‹  ์ฒด๊ณ„์˜ ์ฃผ์ฒด: RubikPi์—์„œ ์ „์†กํ•˜๋Š” ๊ฐ์ง€ ๊ฒฐ๊ณผ(ํœ ์ฒด์–ด ์—ฌ๋ถ€ ๋“ฑ)๋ฅผ ์ˆ˜์‹ ํ•˜์—ฌ ํ‚ค์˜ค์Šคํฌ ์•ฑ์— ์ „๋‹ฌ
  • Arduino ์ œ์–ด ๋ช…๋ น(UP/DOWN)๋„ MQTT ํ†ตํ•ด ์†ก์ˆ˜์‹ 
  • ์‚ฌ์šฉ์ž์˜ ํ‚ค์˜ค์Šคํฌ ์ด์šฉํ๋ฆ„์— ๋งž๊ฒŒ MQTTํ†ต์‹  ์ œ์–ด

4. On-Device AI ๋ฐ IoT ์—ฐ๋™

  • On-Device AI ๊ธฐ๋ฐ˜ ํœ ์ฒด์–ด ๊ฐ์ง€ ์—ฐ์‚ฐ์€ RubikPi์—์„œ ์ˆ˜ํ–‰๋˜๋ฉฐ, ๋ผ์ฆˆ๋ฒ ๋ฆฌํŒŒ์ด๋Š” ๊ทธ ๊ฒฐ๊ณผ์— ๋”ฐ๋ผ ์‹ค์ œ ํ™”๋ฉด ์ œ์–ด ๋ฐ ์•ˆ๋‚ด์Œ ์žฌ์ƒ, ํ•˜๋“œ์›จ์–ด ๋ช…๋ น ์ „์†ก์„ ์ˆ˜ํ–‰
  • IoT ๊ตฌ์„ฑ ์š”์†Œ(์•„๋‘์ด๋…ธ, ์•ก์ถ”์—์ดํ„ฐ, L298N ๋“ฑ)์™€์˜ ์ธํ„ฐํŽ˜์ด์Šค ๋‹ด๋‹น

๐Ÿ“ ๊ตฌ์„ฑ ์š”์•ฝ

๋ผ์ฆˆ๋ฒ ๋ฆฌํŒŒ์ด๋Š” ํ‚ค์˜ค์Šคํฌ ์ „์ฒด ํ๋ฆ„์„ ์‚ฌ์šฉ์ž ์ค‘์‹ฌ์œผ๋กœ ํ†ตํ•ฉ ์ œ์–ดํ•˜๋Š” ๋””๋ฐ”์ด์Šค๋กœ์จ,
AI ์—ฐ์‚ฐ์„ ๋‹ด๋‹นํ•˜๋Š” RubikPi, ์ œ์–ด ๋ชจ๋“ˆ์ธ Arduino, ์‚ฌ์šฉ์ž ์ธํ„ฐํŽ˜์ด์Šค์ธ React ์•ฑ์„ ํ•˜๋‚˜๋กœ ์—ฎ๋Š” ํ—ˆ๋ธŒ ์—ญํ• ์„ ํ•œ๋‹ค.

์‚ฌ์šฉ์ž ์ ‘๊ทผ์„ฑ ํ–ฅ์ƒ์„ ์œ„ํ•ด ์‹œ๊ฐ์  UI๋ฟ๋งŒ ์•„๋‹ˆ๋ผ ์Œ์„ฑ ๋ช…๋ น ๊ธฐ๋ฐ˜ ์กฐ์ž‘์„ ์ง€์›ํ•œ๋‹ค.

ํœ ์ฒด์–ด ์‚ฌ์šฉ์ž ์ ‘๊ทผ ์‹œ ์ž๋™์œผ๋กœ ์‹œ์Šคํ…œ์ด ๋ฐ˜์‘ํ•˜๊ณ , ์•ก์ถ”์—์ดํ„ฐ ์ œ์–ด ๋ฐ ์ธํ„ฐํŽ˜์ด์Šค ์•ˆ๋‚ด๊ฐ€ ์ด๋ฃจ์–ด์ง„๋‹ค.